-- Logs begin at Wed 2022-08-31 03:26:41 UTC, end at Wed 2022-08-31 04:22:58 UTC. -- Aug 31 03:52:21.372319 dv-cinder-853910-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 03:52:21.383219 dv-cinder-853910-5-smb devstack@keystone.service[81510]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 03:52:21 2022] *** Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: nodename: dv-cinder-853910-5-smb Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: machine: x86_64 Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: clock source: unix Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: pcre jit disabled Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: detected number of CPU cores: 4 Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: current working directory: / Aug 31 03:52:21.385276 dv-cinder-853910-5-smb devstack@keystone.service[81510]: detected binary path: /usr/bin/uwsgi-core Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: your processes number limit is 47680 Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: your memory page size is 4096 bytes Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: detected max file descriptor number: 2048 Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: lock engine: pthread robust mutexes Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: thunder lock: enabled Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 03:52:21.385868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 03:52:21.423868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: Python main interpreter initialized at 0x56361de9a9c0 Aug 31 03:52:21.423868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: python threads support enabled Aug 31 03:52:21.423868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: your server socket listen backlog is limited to 100 connections Aug 31 03:52:21.423868 dv-cinder-853910-5-smb devstack@keystone.service[81510]: your mercy for graceful operations on workers is 90 seconds Aug 31 03:52:21.424268 dv-cinder-853910-5-smb devstack@keystone.service[81510]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 03:52:21.424268 dv-cinder-853910-5-smb devstack@keystone.service[81510]: *** Operational MODE: preforking *** Aug 31 03:52:21.424560 dv-cinder-853910-5-smb devstack@keystone.service[81510]: *** uWSGI is running in multiple interpreter mode *** Aug 31 03:52:21.424560 dv-cinder-853910-5-smb devstack@keystone.service[81510]: spawned uWSGI master process (pid: 81510) Aug 31 03:52:21.424722 dv-cinder-853910-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 03:52:21.425968 dv-cinder-853910-5-smb devstack@keystone.service[81510]: spawned uWSGI worker 1 (pid: 81521, cores: 1) Aug 31 03:52:21.425968 dv-cinder-853910-5-smb devstack@keystone.service[81510]: spawned uWSGI worker 2 (pid: 81522, cores: 1) Aug 31 03:52:21.425968 dv-cinder-853910-5-smb devstack@keystone.service[81510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 03:52:25.668517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:52:25.668517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: from cryptography.utils import int_from_bytes Aug 31 03:52:25.669363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:52:25.669363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: from cryptography.utils import int_from_bytes Aug 31 03:52:25.673789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:52:25.673789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: from cryptography.utils import int_from_bytes Aug 31 03:52:25.674305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 03:52:25.674305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: from cryptography.utils import int_from_bytes Aug 31 03:52:25.718741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 03:52:25.718934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 03:52:25.719076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] command line args: [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 03:52:25.719379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 03:52:25.719508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ================================================================================ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 03:52:25.719791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] admin_token = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.720029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config_dir = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.720190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.720407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] config_source = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.720548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] debug = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.720764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 03:52:25.722322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 03:52:25.722379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] command line args: [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 03:52:25.722499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 03:52:25.722673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_config_append = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ================================================================================ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 03:52:25.722794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] admin_token = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_dir = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.722980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config_dir = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] config_source = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] debug = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.723931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_config_append = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_dir = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.724989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.725820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] publish_errors = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.726915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.727978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] standard_threads = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_journal = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.728923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_json = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_stderr = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] publish_errors = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] use_syslog = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.729838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.729979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.730074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.730204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.730293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.730435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] standard_threads = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.730530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.730648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.730733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.730902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.731022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.731101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.731173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.731253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_journal = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.731332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.731409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_json = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.731555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_stderr = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.731643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.731721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] use_syslog = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.731801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.731944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 03:52:25.732034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.732939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.733990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.734943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.735864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.736989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.737946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.738969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.739874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.740833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.741951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.742953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.743867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.744943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.745977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.746928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.747965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.748967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.749883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.750910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.751835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.752261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.752373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.752484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.752639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.752851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.752851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.753941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.754983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.external = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.755998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.password = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.token = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.756937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.757993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.external = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.758899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.password = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] auth.token = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.759917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.760928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.761993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.762907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.763924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.764992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.765921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.766933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.767981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.768914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.769910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.770956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.771989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.772978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.773905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.774805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.775945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.776979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.777966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.778988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.779919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.780915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.781952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.782973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.783902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.784936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.785878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.786961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.787880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.788717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.789958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.790996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.791902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.792954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.793896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.794895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.795946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.796916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.797964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.798964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.799880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.800963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.801994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.802926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.803930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.804912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.805129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.806057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.806057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.806057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 03:52:25.806057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81521) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 03:52:25.832257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.832486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.832714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.834294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.834526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.834777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.841114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.843806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.869207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.869407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.871992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.872362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.923371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.923531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.971272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.971502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.971774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:25.972009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.126028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.126236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.126462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.126587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.126756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.127873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.150461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.150760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.150904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151802 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.151984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.163005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.163303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.175864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.175995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.176943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.177019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.177132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.177353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81521) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 03:52:26.193915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.194127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 03:52:26.194299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.194461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.194552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 03:52:26.194633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 03:52:26.194834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.194957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.195091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 03:52:26.195170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.195246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.195409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.195612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.195695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.196038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.196303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.205230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.205510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.205632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.205759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.205842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.206047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.206171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.206396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.213038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.213459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.215913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.216193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.216315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.216451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.216586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.216788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.216953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.217963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.218097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.218190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.218366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.218534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.218628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.218830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.219114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.241037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.241509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.242495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.242777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.242979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.243267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.247265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.247548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.247833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.247955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.248176 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.248462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.254584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.254874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.255051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.255363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.258807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.259099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.259405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.259527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.259671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.259774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.259976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.260103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.260296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.260565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.260839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.261135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.261406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.261937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.262245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.262518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.278040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.278312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.278441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.278592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.282177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.282422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.285265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.285564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.285687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.285939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.289924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.290143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.293073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.293286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.296121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.296422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.296683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.296763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.297868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.313352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.313552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.313676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.313809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.313888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.314090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.314212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.314346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.320840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.321230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.322506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.322758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.324049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.324298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.324422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.324558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.326947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.327210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.327338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.327537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.327660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.327809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.327936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.328057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.328188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.328458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.339306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.339589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.339754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.339850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.340965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.341049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.341281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.341572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.356123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.356833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.359140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.359708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.362084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.362596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.363529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.364023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.365026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.365310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.365606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.365729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.365885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.366262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.372305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.372639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.373808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.374140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.376638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.377285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.377407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.377543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.377739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.377890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.377977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.378286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.385720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.386007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.386149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.386334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.386461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.386610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.393228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.393502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81521) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 03:52:26.393626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.393776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.393857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.394867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395893 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.395979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.396780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.397023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81521) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 03:52:26.430187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56361de9a9c0 pid: 81522 (default app) Aug 31 03:52:26.430579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56361de9a9c0 pid: 81521 (default app) Aug 31 03:52:26.433578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ecdf-6966-4a89-9bbc-1f0e362a5976 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:26.433867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ecdf-6966-4a89-9bbc-1f0e362a5976 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:26.434135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ecdf-6966-4a89-9bbc-1f0e362a5976 None None] PATH_INFO: `/v3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:26.438350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Wed Aug 31 03:52:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:32.943330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:32.943897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:32.943897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:32.951086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:32.956700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:32.957215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:32.957352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:33.027799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: INFO dbcounter [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] Registered counter for database keystone Aug 31 03:52:33.048697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG oslo_db.sqlalchemy.engines [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:52:33.058357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writer thread running {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:52:33.237978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG passlib.handlers.bcrypt [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81522) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 03:52:33.238289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG passlib.handlers.bcrypt [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81522) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 03:52:33.297823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:33.299437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:33.430104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 03:52:33.887355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:33.960045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: INFO dbcounter [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] Registered counter for database keystone Aug 31 03:52:33.985268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG oslo_db.sqlalchemy.engines [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81521) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 03:52:33.994666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writer thread running {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 03:52:34.113042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2b4a1-1c6b-413d-b335-c7448364d1a6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:34.118540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:34.119184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:34.119459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:34.119728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:34.129190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:34.179766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 03:52:34.180104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f97ec-6b4e-4ff4-89b7-0043829d82e5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:34.190283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Aug 31 03:52:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:52:34.197710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:34.219482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19d54-e7cb-4f35-9e77-a750b1d74112 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:34.227339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:34.229034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:34.229433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:34.229812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] PATH_INFO: `/v3/projects/7f412dcfcdac460e92b9728f91705fbb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:34.232481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] RBAC: Authorizing `identity:get_project(project_id=7f412dcfcdac460e92b9728f91705fbb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:34.293577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 03:52:34.293926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80f828-b12d-4d6c-9811-997901dd700d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:34.298524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Aug 31 03:52:34 2022] GET /identity/v3/projects/7f412dcfcdac460e92b9728f91705fbb => generated 344 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:36.160868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebf42-6d35-4f8a-8e66-84b1f8d1e3c4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:36.161817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebf42-6d35-4f8a-8e66-84b1f8d1e3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:36.161817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ebf42-6d35-4f8a-8e66-84b1f8d1e3c4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:36.168517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:36.175231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:36.175933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:36.176065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:36.197734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:36.199318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:36.207793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 03:52:36.470604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebf42-6d35-4f8a-8e66-84b1f8d1e3c4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:36.485079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ebf42-6d35-4f8a-8e66-84b1f8d1e3c4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:36.490452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bfe9e-a900-4a56-afde-441aa450a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:36.491085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bfe9e-a900-4a56-afde-441aa450a8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:36.491365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bfe9e-a900-4a56-afde-441aa450a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:36.491634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bfe9e-a900-4a56-afde-441aa450a8a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:36.500037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bfe9e-a900-4a56-afde-441aa450a8a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:36.501876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bfe9e-a900-4a56-afde-441aa450a8a3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:36.511162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Aug 31 03:52:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:52:36.517292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:36.532199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b945f-3893-453d-9c14-ee59bff48be0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:36.540045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7139e91-c3c7-45e2-9435-fc83d0e38ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:36.540681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7139e91-c3c7-45e2-9435-fc83d0e38ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:36.540992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7139e91-c3c7-45e2-9435-fc83d0e38ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:36.541261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7139e91-c3c7-45e2-9435-fc83d0e38ed6 admin admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:36.542720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7139e91-c3c7-45e2-9435-fc83d0e38ed6 admin admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:36.544562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7139e91-c3c7-45e2-9435-fc83d0e38ed6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:36.546121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Aug 31 03:52:36 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:38.469530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade463c2-8909-4bf2-af9a-3cb5ee8b9d33 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:38.470116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade463c2-8909-4bf2-af9a-3cb5ee8b9d33 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:38.470116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade463c2-8909-4bf2-af9a-3cb5ee8b9d33 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:38.471401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:38.476612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:38.477041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:38.477196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:38.495512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:38.496682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:38.518232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54681-32f2-4fdc-ae7a-ccb237757f5a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:38.518515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54681-32f2-4fdc-ae7a-ccb237757f5a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:38.518785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae54681-32f2-4fdc-ae7a-ccb237757f5a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:38.520147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:38.525247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:38.525505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:38.525802 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:38.567851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG passlib.handlers.bcrypt [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81521) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 03:52:38.568287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG passlib.handlers.bcrypt [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81521) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 03:52:38.578115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:38.616856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:38.618437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:38.728888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:38.839200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:38.863532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:38.945089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afd70-34bf-4beb-a4f8-f5a567ff885a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:38.981548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:38.982119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:38.982399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:38.982670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:38.993268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:38.995170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:39.004306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:39.005296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:39.006117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:39.011299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:39.092185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:39.096192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc396e-55f3-4f72-ad6a-c801e515a507 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.098702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:39.112121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ed6f-2e3a-4a83-b621-8264b684c646 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.134280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.135149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.135438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.135740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.146062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.146670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.146950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.147276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.147948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:39.148251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.149671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.161394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:39.166811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:39.202273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.203798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.263938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c59d1-e339-4dbb-b5ed-68635955276e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.296308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.296953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.297246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.297501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.298603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.300033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.300780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:52:39.301596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:39 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:39.306846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:39.306982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:39.310985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:39.321839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:39.415826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633ac5a-910c-437c-8735-43c0d1202d01 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.421024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe6b5-c136-498b-b7ec-a067ea64af9b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.449897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.450763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.451048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.451317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.452648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.454126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.455675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:39.455835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.456464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.456738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.457035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.461519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:39.467565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.469052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:52:39.484583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:39.485945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:52:39.486751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:52:39.486751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:52:39.486751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:39.486751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:39.491467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:39.534419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:39.553991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:39.564745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b0cf-b6f0-4b9f-bbb8-ae372326379e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.593525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4327d-53b2-4e36-9b09-3857d96b093b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:39.597953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.598570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.598873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.599144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.599906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.domain.id=default, user.id=04aa24ab71874e53bb3391c530b11528) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:39.600292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.601762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b59ef-f0c5-4b44-b1ca-c77d6d3816fe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.610382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Aug 31 03:52:39 2022] GET /identity/v3/role_assignments?user.id=04aa24ab71874e53bb3391c530b11528&scope.domain.id=default&role.id=faea311d34554d2b9ce4434210a27c8f => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:39.633518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:39.635596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:39.636079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:39.636557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:39.637666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:39.637975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:39.640021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cfd76-4830-497a-a0c7-5ae2023b513b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:39.660985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:41.644062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf847cc-5501-4aff-b052-3955eb32485f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:41.644606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf847cc-5501-4aff-b052-3955eb32485f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:41.644606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf847cc-5501-4aff-b052-3955eb32485f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:41.646254 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:41.654393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580c92-cf91-4932-ab53-2f7e511b6a86 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:41.655993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580c92-cf91-4932-ab53-2f7e511b6a86 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:41.656080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580c92-cf91-4932-ab53-2f7e511b6a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:41.686304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-43580c92-cf91-4932-ab53-2f7e511b6a86 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:41.687503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-43580c92-cf91-4932-ab53-2f7e511b6a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:41.785592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:41.844270 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003f386-943c-4ea4-b61c-6d116abfff49 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:41.844550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003f386-943c-4ea4-b61c-6d116abfff49 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:41.844828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003f386-943c-4ea4-b61c-6d116abfff49 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:41.846173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:41.851539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:41.851831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:41.852113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:41.881875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:41.883077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:41.946181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:41.956984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20b143-5446-4a5e-8b65-1ce1f49bc1e5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:41.957596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20b143-5446-4a5e-8b65-1ce1f49bc1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:41.958062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20b143-5446-4a5e-8b65-1ce1f49bc1e5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:41.959647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 13/25] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:41.964596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:41.965123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:41.965591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:41.967500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:42.001778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:42.003595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:42.094064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:52:42.167238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:42.292919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436f0a-2afe-48f7-80cf-8ec2037aee6a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:42.339359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:42.340011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:42.340291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:42.340564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:42.354789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:42.359655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:42.360511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:42.361307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 14/28] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:42.366777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:42.438949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:42.484030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e8b8-0d20-4acc-b5fe-54a9557e0730 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:42.511156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:42.531843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:42.532472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:42.532749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:42.533038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:42.533709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:42.534011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:42.535402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:42.551981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:42.552769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:42.609938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:42.659179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc15bd6-be6c-4909-9709-41bc818d97fb None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:42.689305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:42.708334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:42.709289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:42.709795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:42.710238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:42.711124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:42.712683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:42.718039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb71093-0fdc-4e4a-8c04-9c2c27964f01 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:42.756937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:42.757840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:42.758278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:42.758685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:42.769501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:42.771156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:52:42.786567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:42.787679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:52:42.788604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:52:42.788604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:52:42.788604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:42.790288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 15/30] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:52:42.791205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:42.904412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:42.911376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4a8b4-0f3f-4ab1-91ad-154244bb17c6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:42.913222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 16/31] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Aug 31 03:52:42 2022] POST /identity/v3/roles => generated 219 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:42.914459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:42.950835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8a051-1f62-49c4-99cf-4cd20a74a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:42.951735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a051-1f62-49c4-99cf-4cd20a74a772 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:42.952258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a051-1f62-49c4-99cf-4cd20a74a772 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:42.952667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a051-1f62-49c4-99cf-4cd20a74a772 None admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:42.954034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8a051-1f62-49c4-99cf-4cd20a74a772 None admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:42.955653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8a051-1f62-49c4-99cf-4cd20a74a772 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:42.957990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 16/32] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:42 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:42.959368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb805da-f11d-42d1-baee-3059e7c3b550 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:42.959870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb805da-f11d-42d1-baee-3059e7c3b550 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:42.960265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb805da-f11d-42d1-baee-3059e7c3b550 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:42.961825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:42.963089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb805da-f11d-42d1-baee-3059e7c3b550 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:43.078390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb805da-f11d-42d1-baee-3059e7c3b550 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:43.108988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03744eb8-bca8-4d33-9213-c4e0fa1eea4b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:43.116717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8a36-3bb9-4854-af17-d5ea5f7e1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:43.117714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8a36-3bb9-4854-af17-d5ea5f7e1a77 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.118204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8a36-3bb9-4854-af17-d5ea5f7e1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.118679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8a36-3bb9-4854-af17-d5ea5f7e1a77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.120101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae8a36-3bb9-4854-af17-d5ea5f7e1a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:43.121791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae8a36-3bb9-4854-af17-d5ea5f7e1a77 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:43.123623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:43.125047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.125553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.126124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.146135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:43.147728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:43.174887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:43.175442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.175725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.176003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.176700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:43.177113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:43.178826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:43.179507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:43.210012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:43.211348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:43.228610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:43.229743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:43.263805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:43.337190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e03e6-c604-4c34-8ecb-b24a624aa3b1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:43.345442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815b00-106c-4547-9271-e5834a3cd0d2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:43.377485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0abc19-260d-4da8-ba55-c2844d36ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:43.378366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0abc19-260d-4da8-ba55-c2844d36ace8 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.378808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0abc19-260d-4da8-ba55-c2844d36ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.379219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0abc19-260d-4da8-ba55-c2844d36ace8 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.380110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0abc19-260d-4da8-ba55-c2844d36ace8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:43.381917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0abc19-260d-4da8-ba55-c2844d36ace8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:43.398389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689bdc3-1712-4e1a-ae51-a2ea3b9a8724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:43.399315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689bdc3-1712-4e1a-ae51-a2ea3b9a8724 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.400175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689bdc3-1712-4e1a-ae51-a2ea3b9a8724 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.400653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689bdc3-1712-4e1a-ae51-a2ea3b9a8724 None admin] PATH_INFO: `/v3/domains/default/users/04aa24ab71874e53bb3391c530b11528/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.403421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689bdc3-1712-4e1a-ae51-a2ea3b9a8724 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=04aa24ab71874e53bb3391c530b11528, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:43.405276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689bdc3-1712-4e1a-ae51-a2ea3b9a8724 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:43.430573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 18/37] 10.222.0.25 () {58 vars in 1361 bytes} [Wed Aug 31 03:52:43 2022] PUT /identity/v3/domains/default/users/04aa24ab71874e53bb3391c530b11528/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:52:43.433269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9de78-feee-4195-bc3a-647ad6d58868 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.433920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9de78-feee-4195-bc3a-647ad6d58868 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.435017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9de78-feee-4195-bc3a-647ad6d58868 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.439696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 19/38] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:43.450394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.450924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.451336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.482522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:43.484336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:43.622019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:43.623122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:43.680053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:43.683870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:52:43 2022] POST /identity/v3/projects => generated 301 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:43.803553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f895d-4936-4af7-a1b6-61b4eb8b6dde None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:43.808752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7985-debb-46b7-a30f-62079f3eec31 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.809283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7985-debb-46b7-a30f-62079f3eec31 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.809365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7985-debb-46b7-a30f-62079f3eec31 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.810878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 21/41] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:52:43.824871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.825199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.825434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.855097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:43.856639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:43.866439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:43.867287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:43.867707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:43.868120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:43.869009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:43.870686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:43.872972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:43.894018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Aug 31 03:52:43 2022] POST /identity/v3/roles => generated 225 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:43.948495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 22/43] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:52:43.965252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:44.079641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:44.083967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56553a-68c5-4b1f-9989-7c555befa91e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:44.124543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:44.125228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:44.125507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:44.125779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:44.126467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:44.128155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:44.145443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Aug 31 03:52:43 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:44.226367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:44.333778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8f0ae-217d-4f8e-9dc5-3fbda4328a60 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:44.368059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a10f20-fd9c-4101-9487-1c03e04d1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:44.368703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a10f20-fd9c-4101-9487-1c03e04d1c58 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:44.369007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a10f20-fd9c-4101-9487-1c03e04d1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:44.369282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a10f20-fd9c-4101-9487-1c03e04d1c58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:44.370390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a10f20-fd9c-4101-9487-1c03e04d1c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:44.371992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a10f20-fd9c-4101-9487-1c03e04d1c58 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:44.373609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 23/45] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:44.379753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:44.482141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5cf48-3d85-4740-a23a-6634c9149e92 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:44.516380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513cb64-d19b-4de6-acd0-b7994787f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:44.517023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513cb64-d19b-4de6-acd0-b7994787f333 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:44.517305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513cb64-d19b-4de6-acd0-b7994787f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:44.517579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513cb64-d19b-4de6-acd0-b7994787f333 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:44.518246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513cb64-d19b-4de6-acd0-b7994787f333 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:44.519699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513cb64-d19b-4de6-acd0-b7994787f333 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:44.553907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:52:44 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:52:45.465097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ea9fa-6c8a-46b4-8838-c3b4533e08b4 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:45.465661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ea9fa-6c8a-46b4-8838-c3b4533e08b4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:45.465661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ea9fa-6c8a-46b4-8838-c3b4533e08b4 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:45.466975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:45.472439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:45.472883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:45.472990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:45.491698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:45.492916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:45.495785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:45.562947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:52:45.826802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ea9fa-6c8a-46b4-8838-c3b4533e08b4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:45.842754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:45.928743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ea9fa-6c8a-46b4-8838-c3b4533e08b4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:45.962900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:45.963527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:45.963809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:45.964075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:45.974529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:45.979466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:45.980431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:45.981235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:45.986643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:46.094099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f291cb-3811-44b0-bf8d-64728e953fb0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:46.131259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:46.131919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.132195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.132462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.133176 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:46.133476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:46.134867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:46.143078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 25/50] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:46.148744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:46.219682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:46.249323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aa72d-799e-4bba-8d00-64f419f71af5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:46.283678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c4ea2-09cc-47d4-8908-89c5f112d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:46.284312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4ea2-09cc-47d4-8908-89c5f112d100 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.284594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4ea2-09cc-47d4-8908-89c5f112d100 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.284884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c4ea2-09cc-47d4-8908-89c5f112d100 None admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.286021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c4ea2-09cc-47d4-8908-89c5f112d100 None admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:46.287475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c4ea2-09cc-47d4-8908-89c5f112d100 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:46.289186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 26/51] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:46 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:46.294836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:46.297952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:46.400278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96ce50-fc96-4e16-a6a4-1dc8c9592670 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:46.414614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152cba8-35b0-48a0-ad2b-d7636e25575d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.414894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152cba8-35b0-48a0-ad2b-d7636e25575d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.415165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152cba8-35b0-48a0-ad2b-d7636e25575d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.416659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 27/52] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:46.421429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.421713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.421987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.436063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:46.436697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.437001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.437269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.438378 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:46.439820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:46.439918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:46.441109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:46.441402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:46.447050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:46.509660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:52:46.518396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:46.549273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9f690-7f85-4377-be37-ca689848c3fd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:46.582622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:46.583214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.583498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.583770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.584510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.domain.id=default, user.id=04aa24ab71874e53bb3391c530b11528) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:46.584835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:46.586368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:46.592002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Aug 31 03:52:46 2022] GET /identity/v3/role_assignments?user.id=04aa24ab71874e53bb3391c530b11528&scope.domain.id=default&role.id=faea311d34554d2b9ce4434210a27c8f => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:46.776443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:46.848235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:46.879475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5414-bd00-4166-bab3-9f97f0381cb4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:46.914607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62139c8d-526b-4517-a973-7c4360f46876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:46.915217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139c8d-526b-4517-a973-7c4360f46876 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:46.915495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139c8d-526b-4517-a973-7c4360f46876 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:46.915761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139c8d-526b-4517-a973-7c4360f46876 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:46.917003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62139c8d-526b-4517-a973-7c4360f46876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:46.918437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62139c8d-526b-4517-a973-7c4360f46876 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:46.919971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 29/56] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:46.926086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:47.040286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965dd82-43bb-490b-a3cc-23e9858e29ce None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:47.080994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c6cbd-f6c2-49ea-9780-487b8e02d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:47.081858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6cbd-f6c2-49ea-9780-487b8e02d741 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:47.082264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6cbd-f6c2-49ea-9780-487b8e02d741 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:47.082683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c6cbd-f6c2-49ea-9780-487b8e02d741 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:47.083734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c6cbd-f6c2-49ea-9780-487b8e02d741 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:47.086033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c6cbd-f6c2-49ea-9780-487b8e02d741 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:47.094384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:47.227139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 28/57] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Aug 31 03:52:46 2022] POST /identity/v3/projects => generated 298 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:52:49.128178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e568-ef0a-4830-acac-5a86ca2f29de None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:49.129061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e568-ef0a-4830-acac-5a86ca2f29de None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:49.129199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e568-ef0a-4830-acac-5a86ca2f29de None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:49.131419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:49.137753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:49.138208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:49.138296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:49.165786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:49.166989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:49.250280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:49.512396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e568-ef0a-4830-acac-5a86ca2f29de None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:49.633744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e568-ef0a-4830-acac-5a86ca2f29de None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:49.670727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c24e1-f3f2-4068-9f79-a8fe2456976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:49.671360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c24e1-f3f2-4068-9f79-a8fe2456976c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c24e1-f3f2-4068-9f79-a8fe2456976c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:49.671902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c24e1-f3f2-4068-9f79-a8fe2456976c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:49.673173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c24e1-f3f2-4068-9f79-a8fe2456976c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:49.674624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c24e1-f3f2-4068-9f79-a8fe2456976c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:49.676172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:49.685227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:49.802487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93c5f1-6a55-4083-b796-e3e7234321e7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:49.819281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:49.838390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e0665-bbad-4fbf-90dd-205067f8f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:49.839026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e0665-bbad-4fbf-90dd-205067f8f952 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:49.839289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e0665-bbad-4fbf-90dd-205067f8f952 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:49.839564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e0665-bbad-4fbf-90dd-205067f8f952 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:49.840216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e0665-bbad-4fbf-90dd-205067f8f952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:49.841697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e0665-bbad-4fbf-90dd-205067f8f952 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:49.874380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:52:49 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:52.760263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3ddf0-c1d8-49e5-b382-12e3d3ce4d3e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:52.761132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3ddf0-c1d8-49e5-b382-12e3d3ce4d3e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:52.761616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3ddf0-c1d8-49e5-b382-12e3d3ce4d3e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:52.763137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:52.768251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f139f-8615-4c80-a380-aeefd30513d1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:52.769004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f139f-8615-4c80-a380-aeefd30513d1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:52.769424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f139f-8615-4c80-a380-aeefd30513d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:52.797772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8e5f139f-8615-4c80-a380-aeefd30513d1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:52.799197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8e5f139f-8615-4c80-a380-aeefd30513d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:52.879444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:52.913151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e0f1-90e9-415d-8732-b2f2a1956100 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:52.913773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e0f1-90e9-415d-8732-b2f2a1956100 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:52.914246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e0f1-90e9-415d-8732-b2f2a1956100 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:52.915820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 33/64] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:52.921045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:52.921336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:52.921613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:52.946389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:52.946827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a961-a322-4367-834d-731df133f674 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:52.947325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a961-a322-4367-834d-731df133f674 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:52.947494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:52.947954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a961-a322-4367-834d-731df133f674 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:52.949731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 34/65] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:52:52.954681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:52.955236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:52.955713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:52.981735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:52.991020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:52.993529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:53.069103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:53.097995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 35/67] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:52:53.189476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.231187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:53.306751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c358-ac16-46b6-aeec-3c8232b3cbdb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:53.341737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:53.342743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.343226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.343693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.353999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.368127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:53.380050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:53.380926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:52:53.381736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:52:53.384066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 33/68] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:53.390659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.536335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:53.544140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73489ed3-d6d5-4152-88f3-a249d66ee8af None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:53.546030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953e32c-8c58-47ac-a75f-5bf19806e616 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:53.582832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5043f-3a22-4686-b5d7-5400a7c9d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:53.583482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5043f-3a22-4686-b5d7-5400a7c9d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.583763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5043f-3a22-4686-b5d7-5400a7c9d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.584039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5043f-3a22-4686-b5d7-5400a7c9d9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.586800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:53.587795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:53.588552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.588876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.589155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.590410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:53.591319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:53.592878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:53.596502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5043f-3a22-4686-b5d7-5400a7c9d9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-bad5043f-3a22-4686-b5d7-5400a7c9d9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:53.602544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:53.603436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:53.604178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:53.604751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:53.604751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.606122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:53.607389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fd9fb-87e8-4630-88b8-8f10442096db None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.607745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fd9fb-87e8-4630-88b8-8f10442096db None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.608072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fd9fb-87e8-4630-88b8-8f10442096db None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.610005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 37/71] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:53.611191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fd9fb-87e8-4630-88b8-8f10442096db None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.710279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ba252-b01b-47dc-b441-6c54932ede41 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:53.713876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fd9fb-87e8-4630-88b8-8f10442096db None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:53.743947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:53.744586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.744899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.745180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.747271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e3671-6247-4d6f-ab42-87db68e3e8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:53.747909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e3671-6247-4d6f-ab42-87db68e3e8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.748190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e3671-6247-4d6f-ab42-87db68e3e8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.748468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e3671-6247-4d6f-ab42-87db68e3e8c7 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.755458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:53.760439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:53.761333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 35/72] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:53.762385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.765560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e3671-6247-4d6f-ab42-87db68e3e8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:53.767187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e3671-6247-4d6f-ab42-87db68e3e8c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:53.768781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 38/73] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:53.769953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb3e9-bb93-4db4-ae83-4c30549a2093 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.770239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb3e9-bb93-4db4-ae83-4c30549a2093 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.770512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddb3e9-bb93-4db4-ae83-4c30549a2093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.780592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:53.788424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-72ddb3e9-bb93-4db4-ae83-4c30549a2093 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:53.789605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-72ddb3e9-bb93-4db4-ae83-4c30549a2093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:53.839894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:53.857033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 39/74] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:53.858272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8d37-eb70-4f4a-965d-07379d3fd25a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.858561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8d37-eb70-4f4a-965d-07379d3fd25a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.858839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8d37-eb70-4f4a-965d-07379d3fd25a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.860084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 40/75] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:53.860789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed8d37-eb70-4f4a-965d-07379d3fd25a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.876621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca54be-9b86-4040-9a99-3d6c8ea01f41 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:53.912526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:53.913186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:53.913482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:53.913741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:53.914414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:53.914723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:53.916310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:53.924562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 36/76] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:53.925407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:53.982256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed8d37-eb70-4f4a-965d-07379d3fd25a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.013344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.021034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.021655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.021990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.022262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.022938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:54.023242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.024627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ed352-2c83-436b-94e0-6c15d6f2192c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.033590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 41/77] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:54.035109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.035549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.035837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.039456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28734cbe-3833-4595-9fa0-428cfa8e1bba None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.056930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:54.058131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:54.074798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.075664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.075967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.076241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.104317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.133438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 42/78] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:54.134403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.145335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.147071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.230981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.240971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74315a59-01d0-4cc8-afc6-d1df8b036497 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.257612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 37/79] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:52:54.262946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.277112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.277755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.278028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.278323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.279504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.281024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.287187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 43/80] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:54.287187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.332642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.375491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ca1f-17be-44ff-ad80-47655b819109 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.392997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf62b5-329d-461d-a934-33a7eec02607 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.411674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.412321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.412670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.412997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.414161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.415610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.417241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 38/81] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:54.418004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.428336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.429009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.429289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.429562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.430675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.432116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.436655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 44/82] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:54.436655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.469916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.529254 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9257-a01b-43cd-b962-9fb4b59a1011 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.551445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff9edc-ffbf-499d-9f39-c883012624c6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.564296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.564985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.565258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.565398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.565532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.566982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.568538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.570283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:54.571056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.588772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.589346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.589646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.589910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.655650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.657170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.670083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347ec9b-d76c-4b9c-95ac-abcb1bdf55b5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.683667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.707760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.708399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.708663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.708964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.719831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:54.724660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:54.725691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 40/84] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:54.726834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.761769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 45/85] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:52:54.762601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.776344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.830487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f399d-f679-4d8e-b00a-20d96a5088e6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.862278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861592cf-911b-41df-a2ab-ab8035e14477 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:54.865671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.866287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.866565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.866835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.899577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:54.900639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:54.901016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:54.901370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:54.902596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.904645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:54.908483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:54.930860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 46/86] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:52:54 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:54.931694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:54.944666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:54.946424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.012509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.052980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434890b5-e8dc-4798-80af-4b3ddeea4c88 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.059826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 41/87] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:52:55.061793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.097276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.097912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.098200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.098458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.099209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=376d2847725640009b54fa75123e3d37) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:55.099518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.102627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.108547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 47/88] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:52:54 2022] GET /identity/v3/role_assignments?user.id=376d2847725640009b54fa75123e3d37&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.109775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.149950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.206027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da7ca-e808-4bdd-ab63-66537c600ee7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.249036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.249825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.250197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.250562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.250800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8174-4448-4442-8807-a468a5df1307 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.251423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:55.251820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.253994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.267821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 42/89] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.268966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.295339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.302590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.303366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.303697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.304044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.305401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.307437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.312826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 48/90] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.312826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.393229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62ea6-ce35-467f-ab09-a5aeb34941e1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.429715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.430575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.431011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.431476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.432432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c75fe-b51c-4e10-8cab-75018bc041af None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.432988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.434578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.436381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 43/91] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.437322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.440177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.470333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.471010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.471377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.471654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.473035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.474519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.476412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 49/92] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.478220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.554342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d93dbb-b103-4d44-91f9-875bcc11edf9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.555421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.590839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.591742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.592185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.592591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.593243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0999-1244-472e-9526-774f2a7b5b48 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.593636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=04aa24ab71874e53bb3391c530b11528) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:55.594079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.595674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.601773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 44/93] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/role_assignments?user.id=04aa24ab71874e53bb3391c530b11528&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.602814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:55.633348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.634029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.634598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.634708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.635490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] RBAC: Adding query filter params (role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=376d2847725640009b54fa75123e3d37) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:55.635816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.637394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.644024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 50/94] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/role_assignments?user.id=376d2847725640009b54fa75123e3d37&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:55.680078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.719532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002a48-ac9d-4e74-864b-e862212f3184 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:55.760424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:55.761097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:55.761421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:55.761699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:55.844926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:55.846441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:55.918230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:55.956551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 45/95] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:52:55.962150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:56.087737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b40eca-7ef9-4780-95fa-f98f0c05b8b3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:56.123942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:56.133444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b063fd9-77d2-473c-951f-b254e7cf7d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:56.134373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b063fd9-77d2-473c-951f-b254e7cf7d5c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:56.134845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b063fd9-77d2-473c-951f-b254e7cf7d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:56.135309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b063fd9-77d2-473c-951f-b254e7cf7d5c None admin] PATH_INFO: `/v3/projects/6317e3391fa0449ca0e06159633a4978` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:56.136672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b063fd9-77d2-473c-951f-b254e7cf7d5c None admin] RBAC: Authorizing `identity:get_project(project_id=6317e3391fa0449ca0e06159633a4978)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:56.138338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b063fd9-77d2-473c-951f-b254e7cf7d5c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:56.140212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 51/96] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:52:55 2022] GET /identity/v3/projects/6317e3391fa0449ca0e06159633a4978 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:52:56.146183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:56.276340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2064-de4b-4af0-b3e1-2dda5b63b975 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:56.311576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:56.312194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:56.312473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:56.312747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:56.313582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=6317e3391fa0449ca0e06159633a4978, user.id=376d2847725640009b54fa75123e3d37) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:56.313897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:56.315412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d6a0-f65f-4806-a0b2-5802990b926a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:56.321230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 46/97] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:52:56 2022] GET /identity/v3/role_assignments?user.id=376d2847725640009b54fa75123e3d37&scope.project.id=6317e3391fa0449ca0e06159633a4978&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:57.696921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d16f7b-fb77-456e-ae66-575e5783d50f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:57.697685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d16f7b-fb77-456e-ae66-575e5783d50f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:57.698167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d16f7b-fb77-456e-ae66-575e5783d50f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:57.704709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 52/98] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:57.710428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b351461-7e2b-40f3-aa74-9195c2467fc7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:57.710867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b351461-7e2b-40f3-aa74-9195c2467fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:57.711031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b351461-7e2b-40f3-aa74-9195c2467fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:57.736911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4b351461-7e2b-40f3-aa74-9195c2467fc7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:57.738130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b351461-7e2b-40f3-aa74-9195c2467fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:57.744577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bdc9-d149-4dbe-b0c6-c6cee87d125c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:57.745157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bdc9-d149-4dbe-b0c6-c6cee87d125c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:57.745635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bdc9-d149-4dbe-b0c6-c6cee87d125c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:57.747464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 53/99] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:52:57.753216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191f94-7c88-4296-bcf2-1cff8bfa6852 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:57.753783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191f94-7c88-4296-bcf2-1cff8bfa6852 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:57.754282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191f94-7c88-4296-bcf2-1cff8bfa6852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:57.766078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:57.786812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-93191f94-7c88-4296-bcf2-1cff8bfa6852 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:57.793122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-93191f94-7c88-4296-bcf2-1cff8bfa6852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:57.852219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 47/100] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:57.912198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 54/101] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:52:58.020305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fecda-f36a-4630-95e7-5ca03bf2a8e9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.020613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fecda-f36a-4630-95e7-5ca03bf2a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.020925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fecda-f36a-4630-95e7-5ca03bf2a8e9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.022496 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 48/102] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:58.027540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2de1-0050-4abb-aa87-976ea05011ff None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.027839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2de1-0050-4abb-aa87-976ea05011ff None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.028122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2de1-0050-4abb-aa87-976ea05011ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.053906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-663f2de1-0050-4abb-aa87-976ea05011ff None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:58.055135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-663f2de1-0050-4abb-aa87-976ea05011ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:58.136376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 55/103] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:58.233613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0d94-9b39-43a2-a2cc-317f299f265a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.233928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0d94-9b39-43a2-a2cc-317f299f265a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.234175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0d94-9b39-43a2-a2cc-317f299f265a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.235667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 49/104] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:58.247529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c234126-d342-428e-b714-fd7524b0847c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.247826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c234126-d342-428e-b714-fd7524b0847c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.248110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c234126-d342-428e-b714-fd7524b0847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.273896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6c234126-d342-428e-b714-fd7524b0847c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:58.275036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6c234126-d342-428e-b714-fd7524b0847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:58.341875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:58.354381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 56/105] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:58.391255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0d94-9b39-43a2-a2cc-317f299f265a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:58.464895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c234126-d342-428e-b714-fd7524b0847c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:58.509307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0d94-9b39-43a2-a2cc-317f299f265a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:58.548900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:58.548900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.548900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.548900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.556170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:58.561529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:58.562383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:52:58.563136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 50/106] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:58.569475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:58.602870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:58.656771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c234126-d342-428e-b714-fd7524b0847c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:58.679378 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de724eb-1fa4-46a8-968b-1db0c220c30e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:58.715328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:58.715942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.716224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.716505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.717220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:58.717528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:58.718918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:58.725530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:58.726712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.727182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.727494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 51/107] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:58.727931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.728292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:58.749969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:58.755501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:58.756445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:52:58.757265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:58.759519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 57/108] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:52:58.760630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:58.816214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:58.819847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:58.835326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a93073-2f6c-48db-91f9-312d7a760ee2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:58.870278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd7efb-7832-4a28-a6a7-0a6b484f559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:58.870926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7efb-7832-4a28-a6a7-0a6b484f559c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.871202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7efb-7832-4a28-a6a7-0a6b484f559c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.871480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7efb-7832-4a28-a6a7-0a6b484f559c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.872631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd7efb-7832-4a28-a6a7-0a6b484f559c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:58.875717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd7efb-7832-4a28-a6a7-0a6b484f559c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:58.877851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 52/109] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:58.878430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8b6c2-cd2c-406f-aa7d-81e17b707c29 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:58.885137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1f34-6943-46a4-87b3-17e36b5d8fe6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.885434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1f34-6943-46a4-87b3-17e36b5d8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.885719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1f34-6943-46a4-87b3-17e36b5d8fe6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.886999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 53/110] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:58.889570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1f34-6943-46a4-87b3-17e36b5d8fe6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:58.918572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:58.919229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:58.919958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:58.920241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] PATH_INFO: `/v3/users/456fcff895cb483b9d18e65f89b7e7e9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:58.936388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] RBAC: Authorizing `identity:get_user(user_id=456fcff895cb483b9d18e65f89b7e7e9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:58.937986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:58.945058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 58/111] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/users/456fcff895cb483b9d18e65f89b7e7e9 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:58.945058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.008665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1f34-6943-46a4-87b3-17e36b5d8fe6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.048088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958220c-18a4-4ba7-8fe2-b5eb7bcd062a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.049029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.049751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.050035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.051069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.051244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:59.051574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.053049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.057669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.062807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 54/112] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:59.063717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.079464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.092093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3edeab-b76d-4652-92d8-080dd76d0e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.092747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3edeab-b76d-4652-92d8-080dd76d0e53 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.093056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3edeab-b76d-4652-92d8-080dd76d0e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.093332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3edeab-b76d-4652-92d8-080dd76d0e53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.103770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3edeab-b76d-4652-92d8-080dd76d0e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1d3edeab-b76d-4652-92d8-080dd76d0e53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:59.108687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:59.109587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:52:59.111251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 59/113] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:59.114529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.115004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.115469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.133872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:59.135075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:59.175630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bc149-4b4f-4dad-855e-6556bda1a66a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.212825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 60/114] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:59.212825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.220576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.221321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.221722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.222156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.222866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.224539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.262635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 55/115] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:52:59 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:52:59.263777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.322630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.326997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c7cf3-287f-4f99-b904-142ee126cda9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.340483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.369065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c4aa7-1b37-4666-8be7-73ddf641e194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.369896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c4aa7-1b37-4666-8be7-73ddf641e194 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.370541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c4aa7-1b37-4666-8be7-73ddf641e194 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.370757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c4aa7-1b37-4666-8be7-73ddf641e194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.388079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a687d85-a8e4-41b8-9850-af39fc1c6508 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.427291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.428476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.429000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.429476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.431053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.432790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.434789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 56/116] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:59.435771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.447902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c4aa7-1b37-4666-8be7-73ddf641e194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.449532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c4aa7-1b37-4666-8be7-73ddf641e194 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.546327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1904-5432-4570-8192-6c2cb6817380 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.552647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.559261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 61/117] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:52:59.561421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd9885-44aa-44a7-9166-cfacea27685d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.561931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd9885-44aa-44a7-9166-cfacea27685d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.562394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd9885-44aa-44a7-9166-cfacea27685d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.564733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 62/118] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:52:59.565653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd9885-44aa-44a7-9166-cfacea27685d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.580919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.586780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.587695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.587977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.588250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.588956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:52:59.589261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.591116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.603831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 57/119] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:59.603831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.686385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd9885-44aa-44a7-9166-cfacea27685d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.712925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fdd09-eb76-49b9-a715-ab996d0a857d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.725523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.726171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.726707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.726707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.727833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.729342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.731151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 63/120] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:59.736417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.749819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac7ba3-462f-493d-8dcc-d6b6738c4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.750458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7ba3-462f-493d-8dcc-d6b6738c4729 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.750739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7ba3-462f-493d-8dcc-d6b6738c4729 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.751116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac7ba3-462f-493d-8dcc-d6b6738c4729 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.762881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac7ba3-462f-493d-8dcc-d6b6738c4729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d3ac7ba3-462f-493d-8dcc-d6b6738c4729 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:52:59.768898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:52:59.769742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:52:59.770517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 58/121] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:52:59.771609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.771609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.771762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.793131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:52:59.794429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:52:59.809386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.846180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585be5f-8bc8-408a-a979-849c3710d586 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:52:59.850220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:52:59.871967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:52:59.872847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:52:59.892307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:52:59.893295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:52:59.893865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:52:59.894431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:52:59.895811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:52:59.897574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:52:59.899688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 64/123] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:52:59.900723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.010837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586feab3-7aff-47e8-8b3a-8dc26eaf2c25 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.011989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55516c3-b347-47e0-b4a0-9ce40ca46ebf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.047912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.048620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.048987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.049324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.049777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.050562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.050884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.051330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.051769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/376d2847725640009b54fa75123e3d37/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.052255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.054086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] RBAC: Authorizing `identity:create_grant(project_id=44523f21eb3848998fd4754b45a97f2d, user_id=376d2847725640009b54fa75123e3d37, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.054375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 60/124] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:52:59 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:00.055269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.056246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.059046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:00.074245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 65/125] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:52:59 2022] PUT /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/376d2847725640009b54fa75123e3d37/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:00.075575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.112340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:00.162052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443de0-0fa0-4bd6-aad6-58dc51218252 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.196641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdd8c-3238-4365-87e6-4506f95162fc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.202642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.202642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.202642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.202642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.204724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:00.204724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.204724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.211848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 61/126] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:00.212831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.246136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.247250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.247776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.248264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.249254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] RBAC: Adding query filter params (role.id=47d1901681864d56aa2d031fc233cb1d, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=456fcff895cb483b9d18e65f89b7e7e9) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:00.249766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.251723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.258672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 66/127] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/role_assignments?user.id=456fcff895cb483b9d18e65f89b7e7e9&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=47d1901681864d56aa2d031fc233cb1d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:00.259798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.332440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:00.341075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d616ea-28a5-48fe-af21-706282bd3a63 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.356965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:00.380746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.381419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.381697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.382104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.383315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.384863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.386863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 62/128] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:00.387749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.389068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782953e4-2b84-41f9-9664-98aaffedbe71 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.429269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.430195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.430664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.431129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.432429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.434278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.436049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 67/129] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:00.437156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.499405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8f1b-cf86-4298-b705-a93002651f54 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.534004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.534586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.534870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.535142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.545734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:00.550798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:00.551884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 63/130] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:00.552939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.554471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e1936-e7b5-40ff-be03-a6247e5c047a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.582748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:00.593311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.594167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.594603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.595104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/04aa24ab71874e53bb3391c530b11528/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.596617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:00.598623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=44523f21eb3848998fd4754b45a97f2d, user_id=04aa24ab71874e53bb3391c530b11528, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.600529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.618216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 68/131] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:00 2022] PUT /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/04aa24ab71874e53bb3391c530b11528/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:00.619462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.696919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f9155-f7bc-483a-891f-0ff762274f58 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:00.787234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:00.787975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:00.792828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:00.792828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:00.792828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:00.792828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:00.794109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:00.799951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:00.885294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe7e1-4ebd-4c34-9f57-5e2ef97250e3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:01.003988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9d82-fbf8-4694-946c-82c1adb8951a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:01.025590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:01.026705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.027186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.027687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.028565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:01.029079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:01.030531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:01.033515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:01.063065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 69/133] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:01.072823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:01.091335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:01.092009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.092296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.092566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/376d2847725640009b54fa75123e3d37/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.102726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] RBAC: Authorizing `identity:create_grant(project_id=44523f21eb3848998fd4754b45a97f2d, user_id=376d2847725640009b54fa75123e3d37, role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:01.107326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:01.147343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:00 2022] PUT /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/376d2847725640009b54fa75123e3d37/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:01.173615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:01.271152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cc90-7939-4163-b49d-311cc46a7160 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:01.323486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:01.324165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.324453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.324730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.325928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:01.327396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:01.329049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 70/135] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:01 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:01.335266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:01.482999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd39a-ad9d-46eb-b2f5-a00f46322351 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:01.526428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155e48-60d6-4de7-9b9d-0243fcb3e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:01.526992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155e48-60d6-4de7-9b9d-0243fcb3e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.527267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155e48-60d6-4de7-9b9d-0243fcb3e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.527538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155e48-60d6-4de7-9b9d-0243fcb3e5c0 None admin] PATH_INFO: `/v3/projects/6317e3391fa0449ca0e06159633a4978` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.528661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64155e48-60d6-4de7-9b9d-0243fcb3e5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=6317e3391fa0449ca0e06159633a4978)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:01.530136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64155e48-60d6-4de7-9b9d-0243fcb3e5c0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:01.531773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:01 2022] GET /identity/v3/projects/6317e3391fa0449ca0e06159633a4978 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:01.537786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:01.653430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd340-5727-496b-ad5d-e9b9030f6902 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:01.671049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:01.689659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a57b9-7a8d-434e-b666-28f2c1afcdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:01.690709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a57b9-7a8d-434e-b666-28f2c1afcdf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.691397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a57b9-7a8d-434e-b666-28f2c1afcdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.691744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a57b9-7a8d-434e-b666-28f2c1afcdf0 None admin] PATH_INFO: `/v3/projects/6317e3391fa0449ca0e06159633a4978/users/376d2847725640009b54fa75123e3d37/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.693830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a57b9-7a8d-434e-b666-28f2c1afcdf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6317e3391fa0449ca0e06159633a4978, user_id=376d2847725640009b54fa75123e3d37, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:01.695448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a57b9-7a8d-434e-b666-28f2c1afcdf0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:01.710636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:01 2022] PUT /identity/v3/projects/6317e3391fa0449ca0e06159633a4978/users/376d2847725640009b54fa75123e3d37/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:01.726578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3cc6c-711e-46c8-b415-a5b35a9d84fb None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.727092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3cc6c-711e-46c8-b415-a5b35a9d84fb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.727508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3cc6c-711e-46c8-b415-a5b35a9d84fb None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.729198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 67/138] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:01.738378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:01.738758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:01.739047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:01.760046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:01.763968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:01.856722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 72/139] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:02.221819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3cc6c-711e-46c8-b415-a5b35a9d84fb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:02.272195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:02.350090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3cc6c-711e-46c8-b415-a5b35a9d84fb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:02.385401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29502ce-9d1e-454e-a9a9-046e3516fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:02.386052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29502ce-9d1e-454e-a9a9-046e3516fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:02.386336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29502ce-9d1e-454e-a9a9-046e3516fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:02.386614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29502ce-9d1e-454e-a9a9-046e3516fbf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:02.387733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29502ce-9d1e-454e-a9a9-046e3516fbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:02.389220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29502ce-9d1e-454e-a9a9-046e3516fbf9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:02.390972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 68/140] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:02.398111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:02.518154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a248335-dbfe-4c3a-b4f3-5bb11d67c7e8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:02.529103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:02.566713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f2353-3f9b-4c07-8cda-f783b91268f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:02.567344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f2353-3f9b-4c07-8cda-f783b91268f5 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:02.567629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f2353-3f9b-4c07-8cda-f783b91268f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:02.567908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f2353-3f9b-4c07-8cda-f783b91268f5 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:02.568653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f2353-3f9b-4c07-8cda-f783b91268f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:02.570223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f2353-3f9b-4c07-8cda-f783b91268f5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:02.608018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 73/141] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:02 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:02.942439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f755e0d-736a-47e9-9d50-55d911b2ea6a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:02.943090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f755e0d-736a-47e9-9d50-55d911b2ea6a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:02.943595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f755e0d-736a-47e9-9d50-55d911b2ea6a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:02.945162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 69/142] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:02.950594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:02.951178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:02.952510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bef0c-da43-423a-a593-c90961133f13 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:02.953011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bef0c-da43-423a-a593-c90961133f13 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:02.953491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bef0c-da43-423a-a593-c90961133f13 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:02.954933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 70/143] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:02.955447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:02.959690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:02.960175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:02.960632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:02.987509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:02.990241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:02.996701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:02.998956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:03.117754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 71/144] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:03.122321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 74/145] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:03.398019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:03.435970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:03.503288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1a1f-4fc7-4a04-a625-d3449f66f555 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:03.537440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:03.538435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:03.538899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:03.539351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:03.549825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:03.554862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:03.555701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:03.556468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:03.558693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 72/146] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:03.564734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:03.669555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:03.688974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:03.701959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89ad42-a42b-4df5-931f-1123d720aa3f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:03.756352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:03.757105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:03.757389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:03.757688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:03.758446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:03.758755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:03.760155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:03.773762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 75/147] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:03.789184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:03.795637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:03.810439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56b6e4-c6b9-4afd-9b8c-b4057450e7cc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:03.860647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00297970-30f7-4dda-9b4d-0e634be4f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:03.861312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00297970-30f7-4dda-9b4d-0e634be4f63a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:03.861586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00297970-30f7-4dda-9b4d-0e634be4f63a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:03.861853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00297970-30f7-4dda-9b4d-0e634be4f63a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:03.875911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00297970-30f7-4dda-9b4d-0e634be4f63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-00297970-30f7-4dda-9b4d-0e634be4f63a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:03.881544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:03.882387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:03.883143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:03.889377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 73/148] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:03.891203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a61f4-0463-47d0-bb3f-335c226a3109 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:03.891487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a61f4-0463-47d0-bb3f-335c226a3109 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:03.891756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a61f4-0463-47d0-bb3f-335c226a3109 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:03.893396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 74/149] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:03.897896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a61f4-0463-47d0-bb3f-335c226a3109 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:03.900586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f323-3eaf-4399-93f9-b65bfd0a3c1e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:03.940720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8cca-286c-46a5-9e5b-323c25ac72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:03.941324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8cca-286c-46a5-9e5b-323c25ac72e3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:03.941603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8cca-286c-46a5-9e5b-323c25ac72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:03.941873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8cca-286c-46a5-9e5b-323c25ac72e3 None admin] PATH_INFO: `/v3/users/456fcff895cb483b9d18e65f89b7e7e9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:03.943237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8cca-286c-46a5-9e5b-323c25ac72e3 None admin] RBAC: Authorizing `identity:get_user(user_id=456fcff895cb483b9d18e65f89b7e7e9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:03.948906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8cca-286c-46a5-9e5b-323c25ac72e3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:03.950548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 76/150] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:03 2022] GET /identity/v3/users/456fcff895cb483b9d18e65f89b7e7e9 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:03.951714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:03.951995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:03.952271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:03.999409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:04.003529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:04.040520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:04.109501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a61f4-0463-47d0-bb3f-335c226a3109 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:04.119308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 77/151] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:04.120112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:04.166930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75acce2-f515-4101-b503-72291821e491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:04.167562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75acce2-f515-4101-b503-72291821e491 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.167842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75acce2-f515-4101-b503-72291821e491 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.168118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75acce2-f515-4101-b503-72291821e491 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.168832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75acce2-f515-4101-b503-72291821e491 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:04.169132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75acce2-f515-4101-b503-72291821e491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:04.170536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75acce2-f515-4101-b503-72291821e491 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:04.190055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 75/152] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:04.195748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75acce2-f515-4101-b503-72291821e491 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:04.234708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:04.278937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f40f6-5858-4fce-87a1-916843789cdd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:04.328282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:04.328969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.329253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.329625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.330785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:04.332355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:04.334205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 78/153] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:04 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:04.342090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:04.364043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75acce2-f515-4101-b503-72291821e491 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:04.372224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:04.404191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9366dc4-c7d6-4530-8d4c-149f8d6bc044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:04.405825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9366dc4-c7d6-4530-8d4c-149f8d6bc044 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.406332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9366dc4-c7d6-4530-8d4c-149f8d6bc044 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.406788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9366dc4-c7d6-4530-8d4c-149f8d6bc044 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.408253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9366dc4-c7d6-4530-8d4c-149f8d6bc044 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:04.409996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9366dc4-c7d6-4530-8d4c-149f8d6bc044 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:04.412150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 76/154] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:04 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:04.413661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feba12-b3cd-4e5f-89d3-9f34538760c8 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.414135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feba12-b3cd-4e5f-89d3-9f34538760c8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.414606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feba12-b3cd-4e5f-89d3-9f34538760c8 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.416060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 77/155] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:04.420998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feba12-b3cd-4e5f-89d3-9f34538760c8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:04.491759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957277ad-d40f-42d3-b86e-edfe46cd9750 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:04.514840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:04.532080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feba12-b3cd-4e5f-89d3-9f34538760c8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:04.543698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fa53e-4a6e-4e5f-9419-bfadde5df6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:04.544249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa53e-4a6e-4e5f-9419-bfadde5df6a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.544525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa53e-4a6e-4e5f-9419-bfadde5df6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.545688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fa53e-4a6e-4e5f-9419-bfadde5df6a5 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/456fcff895cb483b9d18e65f89b7e7e9/roles/47d1901681864d56aa2d031fc233cb1d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.546791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa53e-4a6e-4e5f-9419-bfadde5df6a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=44523f21eb3848998fd4754b45a97f2d, user_id=456fcff895cb483b9d18e65f89b7e7e9, role_id=47d1901681864d56aa2d031fc233cb1d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:04.548363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fa53e-4a6e-4e5f-9419-bfadde5df6a5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:04.570782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 79/156] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:04 2022] PUT /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d/users/456fcff895cb483b9d18e65f89b7e7e9/roles/47d1901681864d56aa2d031fc233cb1d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:04.572116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f858b-c3f7-4ada-b052-770be7effc1f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.572233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:04.572475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f858b-c3f7-4ada-b052-770be7effc1f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.572756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f858b-c3f7-4ada-b052-770be7effc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.573494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.574002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.574454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.613002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e81f858b-c3f7-4ada-b052-770be7effc1f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:04.614967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e81f858b-c3f7-4ada-b052-770be7effc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:04.650814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:04.652632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:04.769194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:04.772847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:04.774341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:04.860539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 80/158] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:04.864835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96738af5-9a3f-4505-8dca-9d5258f12862 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.864835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96738af5-9a3f-4505-8dca-9d5258f12862 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.864835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96738af5-9a3f-4505-8dca-9d5258f12862 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.864835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 81/159] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:04.864835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96738af5-9a3f-4505-8dca-9d5258f12862 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:04.898336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:04.899604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06aaf3-4fc1-4116-99f5-1004a912ae5a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:04.940775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78cff0-ed15-4ee8-a23c-d548123a2b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:04.941836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78cff0-ed15-4ee8-a23c-d548123a2b9b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.942331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78cff0-ed15-4ee8-a23c-d548123a2b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.942763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78cff0-ed15-4ee8-a23c-d548123a2b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.955098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78cff0-ed15-4ee8-a23c-d548123a2b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4a78cff0-ed15-4ee8-a23c-d548123a2b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:04.961635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:04.962572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:04.963327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:04.965839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 79/160] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:04.967341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:04.967810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:04.968273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:04.989324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:04.991404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:05.043106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:05.065243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 80/161] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:05.066447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:05.147766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96738af5-9a3f-4505-8dca-9d5258f12862 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:05.172199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070350e3-5c9b-41d7-8a3d-2b1fa8584e15 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:05.208234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:05.209680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:05.210128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:05.210561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:05.211400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:05.211863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:05.213818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:05.223948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 81/162] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:05.230818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:05.241769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:05.242471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:05.242801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:05.243080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:05.244479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:05.246032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:05.247936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 82/163] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:04 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:05.253757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:05.318269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:05.429831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:05.463882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc08163-eb23-48b5-8620-6471e8aa91c7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:05.479578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145baa80-33a1-4ed8-ad6a-15963666042b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:05.528327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:05.528980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:05.529261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:05.529538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:05.530384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=376d2847725640009b54fa75123e3d37) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:05.530702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:05.532164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:05.538706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 83/164] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:05 2022] GET /identity/v3/role_assignments?user.id=376d2847725640009b54fa75123e3d37&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:05.541869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:05.563022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:05.563680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:05.563954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:05.564220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] PATH_INFO: `/v3/users/04aa24ab71874e53bb3391c530b11528` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:05.570363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] RBAC: Authorizing `identity:get_user(user_id=04aa24ab71874e53bb3391c530b11528)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:05.571798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:05.573968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 82/165] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:05 2022] GET /identity/v3/users/04aa24ab71874e53bb3391c530b11528 => generated 247 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:05.587173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:05.723976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67816ef-185f-43b0-ab01-f1e0c4ba42b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:05.802347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:05.803394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:05.803964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:05.804448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:05.829805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:05.835570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:05.836464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:05.837561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:05.839839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 84/166] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:05.844924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:05.847526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29980d4-07d4-4b91-a0fc-d22ad131b09e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:05.849455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:05.858558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:05.922801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:05.923362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:05.923644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:05.923917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.050289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.051912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.059545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fab03-581f-4df9-a527-08ae52627fa4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.120706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.121710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.122195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.122653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.143875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:06.150753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:06.151632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:06.152481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:06.157284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 85/167] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:06.161444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.241870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:06.249969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 83/168] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:53:06.250838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.264256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:06.297190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952418e0-bca2-4bf1-be52-d31ca44462a8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.336519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.337635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.338114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.338592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.339534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:06.340036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.341730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.350736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 86/169] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:06.351756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.398301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f0043-612f-42d3-aebb-13b6b8070e6e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.435402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.436024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.436304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.436578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.437286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:06.437591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.438976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.447416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 84/170] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:06.448057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.507092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1652a-d48c-4ff1-b448-66d09110b98c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.549810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:06.569422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:06.573301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.574257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.576419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.576905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.579904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.589275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.591205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 87/171] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:06.592003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.616173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98257f01-a68b-49ce-b8d6-880624dbb46a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.683501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.684457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.685872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.686356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.697130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.704103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.709407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 85/172] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:06.710448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.785369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190b22-cad9-4f8b-82bc-e6c3580467c3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.816816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f81d-6f13-4507-b6cd-1450e00df912 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:06.840818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.841556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.841942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.842249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] PATH_INFO: `/v3/users/376d2847725640009b54fa75123e3d37` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.849690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] RBAC: Authorizing `identity:get_user(user_id=376d2847725640009b54fa75123e3d37)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.851264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.852310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:06.853100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 88/173] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/users/376d2847725640009b54fa75123e3d37 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:06.853347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:06.853791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:06.854065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.854460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:06.855510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=04aa24ab71874e53bb3391c530b11528) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:06.856005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:06.857618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:06.861052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:06.865019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 86/174] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/role_assignments?user.id=04aa24ab71874e53bb3391c530b11528&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:06.866129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:06.967896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:07.045072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4c9c3-c357-4acc-b41b-13fdc5c8a786 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:07.058702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9426-7fd1-4a99-85d7-7337beb4a80f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:07.100051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14712a9e-78c8-416e-8c39-f56cf34f98f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:07.100670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712a9e-78c8-416e-8c39-f56cf34f98f1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.100996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712a9e-78c8-416e-8c39-f56cf34f98f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.101268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712a9e-78c8-416e-8c39-f56cf34f98f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.175265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14712a9e-78c8-416e-8c39-f56cf34f98f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:07.176745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14712a9e-78c8-416e-8c39-f56cf34f98f1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:07.190170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108ae87-f6d5-41f2-ab2b-c8c8531d4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:07.190820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ae87-f6d5-41f2-ab2b-c8c8531d4a93 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.190954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:07.191084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ae87-f6d5-41f2-ab2b-c8c8531d4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.191356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ae87-f6d5-41f2-ab2b-c8c8531d4a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.284283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108ae87-f6d5-41f2-ab2b-c8c8531d4a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:07.284855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 87/175] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:07.285869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108ae87-f6d5-41f2-ab2b-c8c8531d4a93 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:07.286497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8e5c-9a77-45c5-9e48-b0d3b75b58be None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.286947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8e5c-9a77-45c5-9e48-b0d3b75b58be None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.287458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8e5c-9a77-45c5-9e48-b0d3b75b58be None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.289159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 88/176] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:07.290306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8e5c-9a77-45c5-9e48-b0d3b75b58be None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:07.361292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:07.446998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 89/177] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:07.448574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd6d3-4f71-427c-a5b7-d1defaa2251a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.450340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd6d3-4f71-427c-a5b7-d1defaa2251a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.450810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd6d3-4f71-427c-a5b7-d1defaa2251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.483943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:07.485452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-acadd6d3-4f71-427c-a5b7-d1defaa2251a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:07.487009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-acadd6d3-4f71-427c-a5b7-d1defaa2251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:07.495577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8e5c-9a77-45c5-9e48-b0d3b75b58be None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:07.539124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:07.539669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.539943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.540207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.541336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:07.542932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:07.544660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 89/178] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:07 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:07.545549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:07.566622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 90/179] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:07.567727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27f5a-6507-4a8a-ae54-ab38dba0a9f2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.568013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27f5a-6507-4a8a-ae54-ab38dba0a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.568285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27f5a-6507-4a8a-ae54-ab38dba0a9f2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.569709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 91/180] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:07.570595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cacf3-3d06-4dc6-a05b-5c9f1e542246 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.570872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cacf3-3d06-4dc6-a05b-5c9f1e542246 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.571139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cacf3-3d06-4dc6-a05b-5c9f1e542246 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.572449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 92/181] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:07.576937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cacf3-3d06-4dc6-a05b-5c9f1e542246 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:07.677918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cacf3-3d06-4dc6-a05b-5c9f1e542246 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:07.681008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e3d48-168f-4a4b-8777-405ce54bc307 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:07.681473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:07.723943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:07.724570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.724958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.725365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.726239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] RBAC: Adding query filter params (role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=376d2847725640009b54fa75123e3d37) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:07.726552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:07.728004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1ef8c-93bc-413d-8c8e-3530d8f00312 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:07.730130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b77135-5c1a-4410-92e5-8d75a4fb312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:07.731425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77135-5c1a-4410-92e5-8d75a4fb312b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.732152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77135-5c1a-4410-92e5-8d75a4fb312b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.732615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77135-5c1a-4410-92e5-8d75a4fb312b None admin] PATH_INFO: `/v3/projects/6317e3391fa0449ca0e06159633a4978` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.733954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 93/182] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:07 2022] GET /identity/v3/role_assignments?user.id=376d2847725640009b54fa75123e3d37&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:07.734246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b77135-5c1a-4410-92e5-8d75a4fb312b None admin] RBAC: Authorizing `identity:get_project(project_id=6317e3391fa0449ca0e06159633a4978)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:07.735268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e70f9-c777-4635-87e9-5a9d8f54886a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.735556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e70f9-c777-4635-87e9-5a9d8f54886a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.735828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e70f9-c777-4635-87e9-5a9d8f54886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.736578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b77135-5c1a-4410-92e5-8d75a4fb312b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:07.738460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 90/183] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:07 2022] GET /identity/v3/projects/6317e3391fa0449ca0e06159633a4978 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:07.740076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.740957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.741585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.762838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-599e70f9-c777-4635-87e9-5a9d8f54886a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:07.764161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-599e70f9-c777-4635-87e9-5a9d8f54886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:07.768603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:07.770205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:07.812143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:07.848993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 94/184] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:07.857657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc784a-74ba-4240-81f1-81fd7a6aacb9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:07.857952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc784a-74ba-4240-81f1-81fd7a6aacb9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:07.858200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc784a-74ba-4240-81f1-81fd7a6aacb9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:07.859600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 95/185] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:07.860346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc784a-74ba-4240-81f1-81fd7a6aacb9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:07.877546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 91/186] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:07.886333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:07.974139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.000188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada2596-7dbd-42fa-9343-0564757941ed None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.005079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc784a-74ba-4240-81f1-81fd7a6aacb9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.040870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c53a-626c-4d0c-bb83-6f8a3b8cc03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.042318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c53a-626c-4d0c-bb83-6f8a3b8cc03c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.042810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c53a-626c-4d0c-bb83-6f8a3b8cc03c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.043783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c53a-626c-4d0c-bb83-6f8a3b8cc03c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.056691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c53a-626c-4d0c-bb83-6f8a3b8cc03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:08.057712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.058320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.058598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.058871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.060304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=6317e3391fa0449ca0e06159633a4978, user.id=376d2847725640009b54fa75123e3d37) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:08.060617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.062113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-33e5c53a-626c-4d0c-bb83-6f8a3b8cc03c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:08.064292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:08.065194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:08.065982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:08.066588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 92/187] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:08.067761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.067761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.067940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.074182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 96/188] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:07 2022] GET /identity/v3/role_assignments?user.id=376d2847725640009b54fa75123e3d37&scope.project.id=6317e3391fa0449ca0e06159633a4978&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:08.074906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.089585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:08.091185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:08.118318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.178303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 93/189] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:08.179315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.249570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046a73-bf86-4152-817a-f071bb5fc229 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.299482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.300260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.300539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.300840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.301551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:08.301855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.303199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca72f5c-8de2-46e4-96cb-acd796411324 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.303322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.312903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 97/190] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:08.313590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.326802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.348525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.349605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.350148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.350660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.362937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:08.368283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:08.369187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:08.369981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 94/191] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:08.370630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.395185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.438789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc53b2b-2e41-4d39-aa28-b70ece1febc0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.476007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.476745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.477051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.477325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.478422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.479893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.484849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 98/192] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:08.484978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdeaed-7e7f-4484-862c-c08d2062efc8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.485058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.516311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.516969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.517243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.517508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] PATH_INFO: `/v3/users/39635189f9e249dc963c470545c4b691` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.532414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=39635189f9e249dc963c470545c4b691)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.533929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.535666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 95/193] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/users/39635189f9e249dc963c470545c4b691 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:08.536339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.557972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.579592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e0a8b-9a49-4421-a688-35405d622296 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.609444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.613727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.614479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.614617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.614883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.615571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:08.615867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.617269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.625329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 99/194] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:08.626092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.638417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9daa0-ad2f-4c92-96e5-fb60bf245cf8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.672625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.673302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.673575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.673838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.683723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:08.688701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:08.689640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:08.690463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 96/195] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:08.691180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.726731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5255f-ed5f-4ad6-8954-b9d37d849be9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.760102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.760719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.761025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.761299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.761956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.763404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.774955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.785245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 100/196] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:08 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:08.786417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:08.795108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516e9c-1855-4bb8-b8aa-c8b809ec2684 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.833511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.834111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.834386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.834673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.837869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:08.901330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953b3d2-e951-4a18-b2a1-1a97e55ecc80 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:08.923859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.925656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.940032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:08.940677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:08.940983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:08.941251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] PATH_INFO: `/v3/users/39635189f9e249dc963c470545c4b691` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:08.942382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] RBAC: Authorizing `identity:get_user(user_id=39635189f9e249dc963c470545c4b691)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:08.943869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:08.945790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 101/197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/users/39635189f9e249dc963c470545c4b691 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:08.946584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.018585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.043717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 97/198] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:09.044493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.065957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356505-358a-47d8-baff-cc6b3365bd4e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.089908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.108373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.109275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.109690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.110104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.110782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:09.111367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.112469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.121505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:09.122416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.168663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a852e-b801-429c-87d1-eb22a99de6c4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.213193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.214092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.214559 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.215060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.256306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019b71-fd79-49a2-86b1-fef27772731a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.289861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.295262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.297205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.300138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.301786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.302175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.302538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.303802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.305377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.307620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 103/200] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:09.308480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.339070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.417088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61151f86-867c-4e36-9713-3b74104b2df0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.425709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 98/201] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:09.426493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.463614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.464507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.464975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.465449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] PATH_INFO: `/v3/users/456fcff895cb483b9d18e65f89b7e7e9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.466865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] RBAC: Authorizing `identity:get_user(user_id=456fcff895cb483b9d18e65f89b7e7e9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.468510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.470323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 104/202] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/users/456fcff895cb483b9d18e65f89b7e7e9 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:09.471421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.533301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.556858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d757baf-0a1b-4535-922b-a7a862f22b5d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.576647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a073-05cb-42bb-bfdf-f05dcf86f23d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.603302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.604783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.605258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.605939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.607061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=39635189f9e249dc963c470545c4b691) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:09.607914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.609818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.611814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.612836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.613595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.613947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.614497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.615754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.617702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.618339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 99/203] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/role_assignments?user.id=39635189f9e249dc963c470545c4b691&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:09.619364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.620399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 105/204] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:09.626491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:09.747419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e787c9-ba52-4e28-b044-624af5a3b941 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.805064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.805637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.805913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.806184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.838708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf218d5d-0553-4542-9bda-5ecb0bf90619 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:09.881481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.887087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.888840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.914033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:09.938117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:09.938731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:09.939016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:09.939297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:09.940042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] RBAC: Adding query filter params (role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=39635189f9e249dc963c470545c4b691) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:09.940353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:09.941844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:09.970974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 106/205] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/role_assignments?user.id=39635189f9e249dc963c470545c4b691&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:10.001025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 100/206] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:10.009986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:10.178193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d75f6-f2e0-4cd2-8b7c-517c33fd2802 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:10.212793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70521593-97c5-4138-bdbd-335efaa73057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:10.213454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70521593-97c5-4138-bdbd-335efaa73057 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:10.213728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70521593-97c5-4138-bdbd-335efaa73057 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:10.213993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70521593-97c5-4138-bdbd-335efaa73057 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:10.215116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70521593-97c5-4138-bdbd-335efaa73057 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:10.216619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70521593-97c5-4138-bdbd-335efaa73057 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:10.218797 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 107/207] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:10 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:10.224585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:10.349533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:10.354957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6faeb-b3ae-4594-b748-a61d8169b7aa None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:10.402862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:10.403481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:10.403760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:10.404025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:10.404764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] RBAC: Adding query filter params (role.id=47d1901681864d56aa2d031fc233cb1d, scope.project.id=44523f21eb3848998fd4754b45a97f2d, user.id=456fcff895cb483b9d18e65f89b7e7e9) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:10.405098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:10.406540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcea7e-21e0-4870-861d-033a4bef241b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:10.417298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 101/208] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:10 2022] GET /identity/v3/role_assignments?user.id=456fcff895cb483b9d18e65f89b7e7e9&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=47d1901681864d56aa2d031fc233cb1d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:10.976166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ba97-96bd-4747-be0d-873d5ff1422f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:10.976646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ba97-96bd-4747-be0d-873d5ff1422f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:10.976646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ba97-96bd-4747-be0d-873d5ff1422f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:10.978251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 108/209] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:10.983446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6d99b-a0cf-4713-80e8-76023569aecf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:10.983877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6d99b-a0cf-4713-80e8-76023569aecf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:10.983967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6d99b-a0cf-4713-80e8-76023569aecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.008898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e8f6d99b-a0cf-4713-80e8-76023569aecf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:11.010137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e8f6d99b-a0cf-4713-80e8-76023569aecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:11.091022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 102/210] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:11.133075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11a80-c403-4fb1-bbe9-bc1323d27f17 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.133370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11a80-c403-4fb1-bbe9-bc1323d27f17 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.133615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11a80-c403-4fb1-bbe9-bc1323d27f17 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.134961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 109/211] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:11.140390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.140675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.140974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.159407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:11.160868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:11.227571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 103/212] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:11.363406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11a80-c403-4fb1-bbe9-bc1323d27f17 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:11.433224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:11.475683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11a80-c403-4fb1-bbe9-bc1323d27f17 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:11.511180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:11.511822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.512093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.512359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.522925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:11.531566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:11.532659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:11.533522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:11.534116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:11.534186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 110/213] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:11.539697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:11.563498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:11.653093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad14d-7bc3-487c-8da0-c1460887a7f8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:11.664460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa29ebd-750c-404f-8673-2e3bda122766 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:11.688370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:11.689409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.689895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.690353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.691764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:11.694096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:11.700650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:11.700999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 104/214] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:11.702123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:11.722342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:11.723386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.724002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.724324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.725443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:11.725767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:11.727156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:11.740165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 111/215] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:11.747320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:11.811916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:11.823804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b47f-b45c-4a7f-a4d9-e29fa23f8e28 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:11.859414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe8c2d-9b4a-497c-9b35-fc88a8206b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:11.860032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8c2d-9b4a-497c-9b35-fc88a8206b04 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.860309 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8c2d-9b4a-497c-9b35-fc88a8206b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.860578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe8c2d-9b4a-497c-9b35-fc88a8206b04 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.861308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe8c2d-9b4a-497c-9b35-fc88a8206b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:11.862698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe8c2d-9b4a-497c-9b35-fc88a8206b04 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:11.875548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc936-776c-4e3d-a540-fbd32bc02029 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:11.886617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 105/216] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:11 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:11.887861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336ee4-9d6e-4628-8826-2fce18e81539 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.888140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336ee4-9d6e-4628-8826-2fce18e81539 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.888409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6336ee4-9d6e-4628-8826-2fce18e81539 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.889829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 106/217] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:11.895329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279b34-4df9-43f7-b8c7-b38aa599e631 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.895612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279b34-4df9-43f7-b8c7-b38aa599e631 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.895973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279b34-4df9-43f7-b8c7-b38aa599e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.915869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-63279b34-4df9-43f7-b8c7-b38aa599e631 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:11.917146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-63279b34-4df9-43f7-b8c7-b38aa599e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:11.927041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:11.927740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:11.928049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:11.928321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] PATH_INFO: `/v3/users/26f7c6e8714c4c589905f7226d71504c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:11.947599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] RBAC: Authorizing `identity:get_user(user_id=26f7c6e8714c4c589905f7226d71504c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:11.949720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:11.951989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 112/218] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:11 2022] GET /identity/v3/users/26f7c6e8714c4c589905f7226d71504c => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:11.957864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:11.997553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 107/219] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:12.025262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.074620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52742c3-6447-4d3c-8877-2a4edb83feb1 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.075220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52742c3-6447-4d3c-8877-2a4edb83feb1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.075898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52742c3-6447-4d3c-8877-2a4edb83feb1 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.079088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 108/220] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:53:12.080201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9783c-bcf0-4770-a5af-012854c6af2c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.086451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.086799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.087135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.106259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:12.107529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:12.120055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.120678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.121018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.122119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.193539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:12.195337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:12.201224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 109/221] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:12.244573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.278120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.288193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.317720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 113/222] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:53:12.324036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.416351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0b30-c00e-42fa-b8c5-b4d7c44bc7b1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.452613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831b07-3f42-4716-8e62-6639c788d0d8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.455644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.456290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.456567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.456860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.467415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:12.472313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:12.473182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:12.474386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 110/223] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:12.479429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.496200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.497343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.497343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.499072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.501078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:12.502853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:12.507671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 114/224] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:12.510464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.533184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.559851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.604850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd91bf-d26a-46cf-93dd-73d1cd251154 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.638093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075dd3c-bfc8-42aa-a86e-f6f1e8842cb3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.647296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.648002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.648350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.648723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.649431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:12.649735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:12.652259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:12.663877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 111/225] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:12.664822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.679991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.680562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.680862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.681140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.692557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:12.698175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:12.699026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 115/226] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:12.701147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.779279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.788935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e0540-faf3-453c-bf0c-72915fa02df3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.817257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0685d4-63f3-488a-95d7-c536ecb543da None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:12.819881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:12.833173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.834118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.834394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.834663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.835399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=26f7c6e8714c4c589905f7226d71504c) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:12.835968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:12.838125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:12.845644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/role_assignments?user.id=26f7c6e8714c4c589905f7226d71504c&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:12.847107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.858608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:12.859423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:12.859848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:12.860265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] PATH_INFO: `/v3/users/39635189f9e249dc963c470545c4b691` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:12.861733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] RBAC: Authorizing `identity:get_user(user_id=39635189f9e249dc963c470545c4b691)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:12.863408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:12.865266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 116/228] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/users/39635189f9e249dc963c470545c4b691 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:12.871239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:12.981230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a049-02ee-4786-a618-4d2cb21ccce6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:13.026312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:13.027125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:13.027279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:13.027716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:13.028396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:13.028696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:13.030107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:13.038354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac0512-7667-40e5-8365-3ae2aa2e6539 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:13.039644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 113/229] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:13.046261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:13.108507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:13.113564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:13.114220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:13.114553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:13.114928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:13.117096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:13.118633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:13.120287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:12 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:13.125937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:13.135586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:13.162631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f28cb-99dd-42bc-8c1d-486ac16561fc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:13.200436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:13.201604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:13.202099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:13.202797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] PATH_INFO: `/v3/users/39635189f9e249dc963c470545c4b691` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:13.204141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] RBAC: Authorizing `identity:get_user(user_id=39635189f9e249dc963c470545c4b691)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:13.206170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:13.208233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 114/231] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:13 2022] GET /identity/v3/users/39635189f9e249dc963c470545c4b691 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:13.214619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:13.298814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59871fb-86c4-4e1c-bff7-48dc7a4dfae2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:13.333408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:13.334144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:13.334420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:13.334686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/39635189f9e249dc963c470545c4b691/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:13.336595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] RBAC: Authorizing `identity:create_grant(project_id=4648e1b848a24ba2b01b8dde293e33cd, user_id=39635189f9e249dc963c470545c4b691, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:13.338081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:13.355672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 118/232] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:13 2022] PUT /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/39635189f9e249dc963c470545c4b691/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:13.363116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8baf2-1290-4d69-abf9-434a6202af4a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:13.397221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:13.409801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdedc7-88a6-4c0f-8c9e-131cff9d794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:13.410499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdedc7-88a6-4c0f-8c9e-131cff9d794a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:13.410776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdedc7-88a6-4c0f-8c9e-131cff9d794a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:13.411043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdedc7-88a6-4c0f-8c9e-131cff9d794a None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:13.412227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdedc7-88a6-4c0f-8c9e-131cff9d794a None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:13.414516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdedc7-88a6-4c0f-8c9e-131cff9d794a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:13.417357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 115/233] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:13 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:13.426710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:13.533567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:13.568113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2e3b4-9d12-42d2-a1c2-ddaee92fbe48 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:13.605497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2af12-b7f4-4dbb-a07b-7c8546c87063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:13.606165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2af12-b7f4-4dbb-a07b-7c8546c87063 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:13.606440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2af12-b7f4-4dbb-a07b-7c8546c87063 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:13.606754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2af12-b7f4-4dbb-a07b-7c8546c87063 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/39635189f9e249dc963c470545c4b691/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:13.608882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2af12-b7f4-4dbb-a07b-7c8546c87063 None admin] RBAC: Authorizing `identity:create_grant(project_id=4648e1b848a24ba2b01b8dde293e33cd, user_id=39635189f9e249dc963c470545c4b691, role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:13.610454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2af12-b7f4-4dbb-a07b-7c8546c87063 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:13.627677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 119/234] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:13 2022] PUT /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/39635189f9e249dc963c470545c4b691/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:14.417669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7fec8-46e8-4dee-962b-e90de369357f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:14.418211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7fec8-46e8-4dee-962b-e90de369357f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:14.418485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7fec8-46e8-4dee-962b-e90de369357f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:14.419933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 116/235] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:14.425100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01d84e-ef6f-44ab-981c-d75d426ce88a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:14.425487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01d84e-ef6f-44ab-981c-d75d426ce88a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:14.425807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01d84e-ef6f-44ab-981c-d75d426ce88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:14.450530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ba01d84e-ef6f-44ab-981c-d75d426ce88a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:14.451718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ba01d84e-ef6f-44ab-981c-d75d426ce88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:14.531468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 120/236] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:14.601041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045783c0-c6cb-4025-bde8-15607173cb53 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:14.601343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045783c0-c6cb-4025-bde8-15607173cb53 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:14.601588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045783c0-c6cb-4025-bde8-15607173cb53 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:14.603213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 117/237] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:14.608323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:14.608613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:14.608924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:14.636722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:14.637951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:14.710031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:14.736007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:14.835507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045783c0-c6cb-4025-bde8-15607173cb53 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:14.961806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045783c0-c6cb-4025-bde8-15607173cb53 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.004301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.004972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.005252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.005523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.025663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:15.031014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:15.033090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:15.035006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 118/239] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:15.042402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:15.059065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:15.117659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:15.172905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af881b-992b-4330-ab97-dcbe1bd1c8a6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.198953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0d2bf-cb6f-45d6-b820-fbd6b66061fe None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.211395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641de257-3b10-4f0f-a843-3ec8f2c8d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.211800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de257-3b10-4f0f-a843-3ec8f2c8d07a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.212140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de257-3b10-4f0f-a843-3ec8f2c8d07a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.212361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641de257-3b10-4f0f-a843-3ec8f2c8d07a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.213518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641de257-3b10-4f0f-a843-3ec8f2c8d07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:15.214972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641de257-3b10-4f0f-a843-3ec8f2c8d07a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:15.220169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 119/240] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:15.220169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439437d6-0203-4ee1-ae2e-f85c8ac2c5e7 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.220169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439437d6-0203-4ee1-ae2e-f85c8ac2c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.220169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439437d6-0203-4ee1-ae2e-f85c8ac2c5e7 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.220169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 120/241] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:15.222930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439437d6-0203-4ee1-ae2e-f85c8ac2c5e7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:15.247495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.248560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.249069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.249534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.250402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:15.250909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:15.252833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bcd99-4ba9-46c3-baa1-c6af040f62d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:15.261798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 122/242] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:15.263338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.263814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.264273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.283425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:15.285045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:15.338208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:15.363289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:15.364511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:15.375523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439437d6-0203-4ee1-ae2e-f85c8ac2c5e7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.407684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:15.438418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.439023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.439303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.439603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.441887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:15.443389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:15.482743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 121/244] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:15 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:15.527565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d93ad6-fc71-4cc8-bcae-a6c8c0bbac77 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.571041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.571708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.571983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.572246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] PATH_INFO: `/v3/users/877bbcdce23f43f89d234e2c032e168d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.589697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] RBAC: Authorizing `identity:get_user(user_id=877bbcdce23f43f89d234e2c032e168d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:15.591222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:15.593393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 124/245] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:15 2022] GET /identity/v3/users/877bbcdce23f43f89d234e2c032e168d => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:15.598824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:15.677420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:15.722986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:15.760381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0094bb-a8e0-423f-bdaf-21e9c1ab53a3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.801315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.801934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.802205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.803195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.805939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232531e-709a-4255-9c11-813d1291fd27 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:15.845248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da74b2-9af9-427d-88d3-4c259937d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:15.846115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da74b2-9af9-427d-88d3-4c259937d6ec None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.846393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da74b2-9af9-427d-88d3-4c259937d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.846662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da74b2-9af9-427d-88d3-4c259937d6ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.852655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:15.865481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da74b2-9af9-427d-88d3-4c259937d6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-70da74b2-9af9-427d-88d3-4c259937d6ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:15.866255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:15.867185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:15.867965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 125/246] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:15.869374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef50135-71f3-4e77-8f0b-a809faed4283 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.869374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef50135-71f3-4e77-8f0b-a809faed4283 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.872876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef50135-71f3-4e77-8f0b-a809faed4283 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.872876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 126/247] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:15.879179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:15.879483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:15.879819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:15.883920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:15.885420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:15.904725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:15.906291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:15.992526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 127/248] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:15.993581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.028335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:16.049416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 122/249] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:16.055438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.113668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cad3a-789a-4da6-b540-637fb5e51029 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.139830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:16.155167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.155801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.156078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.156349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.157049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:16.157351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:16.158738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2cd69-0532-45ad-9f17-7c7cd52f1626 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:16.174221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 128/250] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:16.175543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23032b32-9855-4cd6-9d1d-a5cd5d324a62 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.175833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23032b32-9855-4cd6-9d1d-a5cd5d324a62 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.176104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23032b32-9855-4cd6-9d1d-a5cd5d324a62 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.177322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 129/251] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:16.180961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23032b32-9855-4cd6-9d1d-a5cd5d324a62 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.181079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee809095-3b61-4c46-957f-26184b724ddb None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.218804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1fb00-704c-48a5-bdc2-3059a74e2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.219439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1fb00-704c-48a5-bdc2-3059a74e2504 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.219717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1fb00-704c-48a5-bdc2-3059a74e2504 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.219985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1fb00-704c-48a5-bdc2-3059a74e2504 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.221227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1fb00-704c-48a5-bdc2-3059a74e2504 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:16.222789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1fb00-704c-48a5-bdc2-3059a74e2504 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:16.224602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 123/252] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:16.225820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.226097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.226504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.245743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:16.247023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:16.285958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:16.313137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23032b32-9855-4cd6-9d1d-a5cd5d324a62 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.346819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 124/253] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:16.347689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.366465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.368699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.369736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.370019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] PATH_INFO: `/v3/users/26f7c6e8714c4c589905f7226d71504c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.371345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] RBAC: Authorizing `identity:get_user(user_id=26f7c6e8714c4c589905f7226d71504c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:16.373905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:16.378342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 130/254] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/users/26f7c6e8714c4c589905f7226d71504c => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:16.379137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.478683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:16.533655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f90b2a-0987-4c97-8236-32dc7231a944 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.553323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4a030-947c-4ceb-854e-4aced30b65bc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.570406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.571020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.571295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.571568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.572299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] RBAC: Adding query filter params (role.id=47d1901681864d56aa2d031fc233cb1d, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=877bbcdce23f43f89d234e2c032e168d) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:16.572605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:16.574140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:16.580073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 125/255] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/role_assignments?user.id=877bbcdce23f43f89d234e2c032e168d&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=47d1901681864d56aa2d031fc233cb1d => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:16.580954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.617556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.618223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.618594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.618869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.649521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:16.654417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:16.656698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:16.658634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 131/256] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:16.665958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.692230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e702d4-ef02-48ed-a103-fc640d35a96c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.709600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:16.737078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.738023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.738303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.738574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.740028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:16.741695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:16.744198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 126/257] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:16.745083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.801212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:16.852367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1735-375e-4e41-9b12-f7238d6f3d01 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.874116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceda0c1-f98c-4526-a4ae-1b51140b5799 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:16.889097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.889981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.890467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.890923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.891770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:16.892284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:16.893871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:16.909648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 132/258] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:16.910468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:16.916013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:16.916536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:16.916828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:16.917155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:16.937532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:16.947107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:16.947984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:16.948773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 127/259] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:16.949536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.062730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.078570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.122054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ac95-88dd-496a-8eb6-c44d3de2c4c2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.123815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1e85d-51bc-47a2-bc78-cb678df287a0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.189590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.190256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.190535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.190806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] PATH_INFO: `/v3/users/39635189f9e249dc963c470545c4b691` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.192534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=39635189f9e249dc963c470545c4b691)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.193416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.194156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.194433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.194701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/26f7c6e8714c4c589905f7226d71504c/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.197065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.198794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 128/260] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:16 2022] GET /identity/v3/users/39635189f9e249dc963c470545c4b691 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:17.199569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.201193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] RBAC: Authorizing `identity:create_grant(project_id=4648e1b848a24ba2b01b8dde293e33cd, user_id=26f7c6e8714c4c589905f7226d71504c, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.202665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.229885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 133/261] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:16 2022] PUT /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/26f7c6e8714c4c589905f7226d71504c/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:17.231040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.322293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fadd9-3b85-44e8-a208-750480ccf9b6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.360368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.360576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.364929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.364929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.364929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:17.364929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.364929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.373521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 129/262] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:17.373769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.381778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.402666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39815e-df0d-42cd-aa5c-d71c6b8c8007 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.437641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.438649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.439114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.439595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.449912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.512545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.514391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.553621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0a5ec-c7fe-417e-b68a-c40892fa9709 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.600389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.601306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.601725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.602136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] PATH_INFO: `/v3/users/39635189f9e249dc963c470545c4b691` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.604151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] RBAC: Authorizing `identity:get_user(user_id=39635189f9e249dc963c470545c4b691)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.606064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.608242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 130/263] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/users/39635189f9e249dc963c470545c4b691 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:17.622620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.625451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 134/264] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:17.631406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.670898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.712757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.760432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ef406-6674-45f7-b7af-9f038dd78d3b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.767141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313bf86-052e-4285-a2fb-8026d28c3d73 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:17.798045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.798664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.798941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.799210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.830491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:17.831151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:17.831434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:17.831708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:17.837503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.838979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.840979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 135/265] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:17.846728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:17.878508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:17.879966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:17.948938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:17.995051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 131/266] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:53:18.001258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:18.110940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44651a-4552-413b-bd05-5479848daebc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:18.119708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae42df-2c6e-4fa6-bfdd-1026d3f10602 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:18.126190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:18.162544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:18.163418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.163854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.164258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.165574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:18.167161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:18.169285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 132/267] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:18.178217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:18.181014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:18.181645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.181935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.182198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.183007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=39635189f9e249dc963c470545c4b691) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:18.183324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:18.184779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a8e7-b956-4485-9765-609b9da99d45 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:18.191192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 136/268] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:17 2022] GET /identity/v3/role_assignments?user.id=39635189f9e249dc963c470545c4b691&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:18.217035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:18.217872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39050f-433b-4a5b-a17a-535ab17b43d5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.217872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39050f-433b-4a5b-a17a-535ab17b43d5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.218063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39050f-433b-4a5b-a17a-535ab17b43d5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.221004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 137/269] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:53:18.226516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa53347-5397-4933-a678-bb14d128f668 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.226802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa53347-5397-4933-a678-bb14d128f668 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.227081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa53347-5397-4933-a678-bb14d128f668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.261749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cfa53347-5397-4933-a678-bb14d128f668 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:18.262619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfa53347-5397-4933-a678-bb14d128f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:18.302438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb8843-df9e-493d-bde4-c0e31c91bc86 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:18.344228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:18.345333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.347032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.347663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.349072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] RBAC: Adding query filter params (role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=39635189f9e249dc963c470545c4b691) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:18.349675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:18.351352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a78d98-52bc-4b3e-ad92-61885d569f4c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:18.359778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 133/270] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:18 2022] GET /identity/v3/role_assignments?user.id=39635189f9e249dc963c470545c4b691&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:18.418787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 138/271] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:18.514975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f3062-2cad-4286-8b29-8e0f9182b92c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.515525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f3062-2cad-4286-8b29-8e0f9182b92c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.515935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f3062-2cad-4286-8b29-8e0f9182b92c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.517556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 134/272] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:18.523699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.523987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.524259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.551473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:18.552735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:18.628686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:18.752025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f3062-2cad-4286-8b29-8e0f9182b92c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:18.871654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:18.884129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f3062-2cad-4286-8b29-8e0f9182b92c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:18.920217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:18.920884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:18.921162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:18.921427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:18.922518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:18.923961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:18.929062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 135/274] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:18.934126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:18.939322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:18.982337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:19.063867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a455b1-379b-46e9-92ee-19957a778b2a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:19.073239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e37a8-56a5-4d92-b49e-dd7f665c36ab None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:19.103708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:19.104819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.105393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.105877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.114377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:19.117100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.117378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.117647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.118311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:19.120195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:19.120613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:19.126416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:19.127659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:19.128554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:19.131419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 136/275] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:19.140836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:19.149481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 140/276] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:18 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:19.177273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:19.261329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a75bf-5321-41ac-8745-79a057c3a75e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:19.297340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:19.298241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.298659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.299110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.299951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:19.300257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:19.301660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5bf5a-04f8-4da4-a2ae-de10aecc6a63 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:19.310450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 137/277] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:19.316238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:19.406409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:19.427246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a738d0-6ebb-45fc-bb58-8aacd7a7aa18 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:19.458347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b855017-22ea-4028-b7ba-43307f1f3fe0 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.458734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b855017-22ea-4028-b7ba-43307f1f3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.458973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b855017-22ea-4028-b7ba-43307f1f3fe0 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.460307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 138/278] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:19.464458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:19.465308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.465720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.465828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.466070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.466263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] PATH_INFO: `/v3/users/4d0b7a1fdbd24d538b6393f171990f1b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.466360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.483720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] RBAC: Authorizing `identity:get_user(user_id=4d0b7a1fdbd24d538b6393f171990f1b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:19.485329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:19.487093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 141/279] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:19 2022] GET /identity/v3/users/4d0b7a1fdbd24d538b6393f171990f1b => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:19.491386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:19.492902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:19.493333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:19.602286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 139/280] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:19.614983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e02f-697d-4ee3-8305-971bdc4f2f09 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:19.652192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:19.652826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.653092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.653360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.654089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, user.id=4d0b7a1fdbd24d538b6393f171990f1b, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:19.654395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:19.655838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eabdf-a850-4965-a530-2a9318f5798b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:19.661489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 142/281] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Aug 31 03:53:19 2022] GET /identity/v3/role_assignments?user.id=4d0b7a1fdbd24d538b6393f171990f1b&scope.system=all&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:19.876045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:19.892943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:19.918573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827e03-b7dc-423c-bdb8-0539e6e303a9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.918914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827e03-b7dc-423c-bdb8-0539e6e303a9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.919115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827e03-b7dc-423c-bdb8-0539e6e303a9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.920844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 143/282] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:19.925551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:19.925827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:19.926098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:19.958470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:19.959532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:19.961842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:19.990157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560dd3-9606-496d-9054-2dd253adb325 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:20.026237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:20.027244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:20.027716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:20.028200 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:20.040387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:20.046756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:20.047699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:20.048483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:20.050797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 140/283] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:20.056643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:20.116599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 144/284] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:20.135644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:20.162257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099bd9e-a6a9-4d5e-9c69-333772f3a3ae None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:20.197739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:20.198747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:20.199230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:20.199687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:20.200641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:20.201156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:20.202720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:20.211487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 141/285] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:20.217267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:20.340501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ed548-2e8b-4740-b2d0-115cc46c7d0d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:20.385497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:20.386201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:20.386418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:20.386688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] PATH_INFO: `/v3/users/877bbcdce23f43f89d234e2c032e168d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:20.387829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] RBAC: Authorizing `identity:get_user(user_id=877bbcdce23f43f89d234e2c032e168d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:20.389289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:20.390859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 145/286] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:20 2022] GET /identity/v3/users/877bbcdce23f43f89d234e2c032e168d => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:20.396649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:20.439208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:20.459271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:20.512071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91739749-2e0a-4e1b-bd1d-f28566972f95 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:20.545670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:20.546437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:20.546811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:20.547176 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:20.548475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:20.550047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:20.552080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 142/287] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:20 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:20.557764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:20.569132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:20.663297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b2be3-6ec3-435a-96aa-32a7c0789f2b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:20.697949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:20.698724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:20.699064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:20.699407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/877bbcdce23f43f89d234e2c032e168d/roles/47d1901681864d56aa2d031fc233cb1d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:20.702282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] RBAC: Authorizing `identity:create_grant(project_id=4648e1b848a24ba2b01b8dde293e33cd, user_id=877bbcdce23f43f89d234e2c032e168d, role_id=47d1901681864d56aa2d031fc233cb1d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:20.703169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:20.720402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 143/288] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:20 2022] PUT /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/users/877bbcdce23f43f89d234e2c032e168d/roles/47d1901681864d56aa2d031fc233cb1d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:20.747262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efc475-66be-435e-8091-574456fe5f7b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:20.817007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:20.817696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:20.817967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:20.818276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:20.841737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:20.847984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:20.848901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:20.849774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 146/289] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:20.856561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:20.925299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:20.965449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09251c7-3b96-4583-a7a5-06c28b32847b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:21.006216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:21.006831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.007110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.007382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.008054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:21.008354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:21.009751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:21.018614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 144/290] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:21.026981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:21.096230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:21.132236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011efb7-6a73-4a21-a231-01a3608daf07 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:21.166572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:21.167212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.167489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.167763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] PATH_INFO: `/v3/users/26f7c6e8714c4c589905f7226d71504c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.168917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=26f7c6e8714c4c589905f7226d71504c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:21.170381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:21.172313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 147/291] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:21 2022] GET /identity/v3/users/26f7c6e8714c4c589905f7226d71504c => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:21.177776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:21.285413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b4e92-1448-4af6-aff9-35796629ac09 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:21.311343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:21.320271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:21.321418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.321699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.322033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.392290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:21.393838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:21.494918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 145/292] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:21.501930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:21.609409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab292a07-381d-46a7-8b2b-bda645484fa4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:21.644461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c029b6-67e8-480c-a717-335ce38121b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:21.645190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c029b6-67e8-480c-a717-335ce38121b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.645467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c029b6-67e8-480c-a717-335ce38121b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.645737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c029b6-67e8-480c-a717-335ce38121b4 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.646997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c029b6-67e8-480c-a717-335ce38121b4 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:21.648497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c029b6-67e8-480c-a717-335ce38121b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:21.650162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 148/293] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:21 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:21.656146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:21.683487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:21.776547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4ce83-bd8f-4ff7-840a-71fdc9a65b0a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:21.825527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:21.826149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.826428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.826704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.827438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=26f7c6e8714c4c589905f7226d71504c) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:21.827750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:21.829252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c393133-39a2-4628-bde0-130f8721e9fe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:21.840383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 146/294] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:21 2022] GET /identity/v3/role_assignments?user.id=26f7c6e8714c4c589905f7226d71504c&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:21.842017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7a57-bf0c-4289-8207-f77297488c00 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.842455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7a57-bf0c-4289-8207-f77297488c00 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.842593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7a57-bf0c-4289-8207-f77297488c00 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.844120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 149/295] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:21.849980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58f88-2b70-4254-8f17-ae28cbbcb7bb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.850260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58f88-2b70-4254-8f17-ae28cbbcb7bb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.850533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58f88-2b70-4254-8f17-ae28cbbcb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.865836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb9d0-bc9c-42ed-ac3f-324cfbab4a43 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.866144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb9d0-bc9c-42ed-ac3f-324cfbab4a43 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.866387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb9d0-bc9c-42ed-ac3f-324cfbab4a43 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.867722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 150/296] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:21.878024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-72e58f88-2b70-4254-8f17-ae28cbbcb7bb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:21.879573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-72e58f88-2b70-4254-8f17-ae28cbbcb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:21.883949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:21.884232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:21.884508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:21.899240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:21.921054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:21.922276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:21.996929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 147/297] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:22.023872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ead96-fdda-4740-b4b2-5bac84707864 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.024189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ead96-fdda-4740-b4b2-5bac84707864 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.024422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ead96-fdda-4740-b4b2-5bac84707864 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.026097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 148/298] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:53:22.031924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.032130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.032404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.049014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 151/299] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:22.057285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:22.058610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:22.075028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:22.137056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 149/300] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:22.276169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.360907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.391056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efb9be-3e03-4e53-b965-887c75da4bc2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.421146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:22.426387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.427023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.427301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.427618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.438060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:22.442958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:22.443846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:22.444640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 152/301] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:22.445351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.464779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d129-2596-4823-9128-ac9c95989cf6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.501322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.502096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.502940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.503044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.513889 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:22.518814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:22.519690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 150/302] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:22.521658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.535009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:22.562037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e902-4aa4-4e18-a764-50b4cf5fae6d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.596024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.596651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.597557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.597557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.598427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:22.599911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:22.601714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 153/303] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:22.606783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.629480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37d9e-deff-452d-a77d-c8bfc8791798 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.663611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.664305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.664585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.664882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.665547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:22.665849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:22.667233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:22.669749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:22.676878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 151/304] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:22.677025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.726901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0b90d-926e-455b-b92a-2d569e5efc7c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.758634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:22.763087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.763709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.763984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.764256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.764958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:22.765261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:22.766650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:22.775320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 154/305] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:22.775928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.795430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55537cb6-6a68-4455-befe-5e6329485d81 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.830700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.831317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.831592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.831859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] PATH_INFO: `/v3/groups` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.832485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:22.833971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:22.850146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 152/306] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Aug 31 03:53:22 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:22.850146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.899853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9bb7f-5029-4e56-8dc3-e84eca52302c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:22.928772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:22.942842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:22.944042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:22.944679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:22.945088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] PATH_INFO: `/v3/users/4d0b7a1fdbd24d538b6393f171990f1b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:22.946520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] RBAC: Authorizing `identity:get_user(user_id=4d0b7a1fdbd24d538b6393f171990f1b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:22.948898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:22.952970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 155/307] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/users/4d0b7a1fdbd24d538b6393f171990f1b => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:22.961880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:22.995682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7e387-b99a-4c50-9749-ba922d00d6f3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:23.035704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:23.042802 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:23.043628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.044050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.044498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] PATH_INFO: `/v3/users/da94f231e7e94779b1ead0e3adfb0a6a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.062672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] RBAC: Authorizing `identity:get_user(user_id=da94f231e7e94779b1ead0e3adfb0a6a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:23.064128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:23.069290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 153/308] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:22 2022] GET /identity/v3/users/da94f231e7e94779b1ead0e3adfb0a6a => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:23.072448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:23.105689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e6cb3-29ec-4c97-9b51-ae27f4fe4377 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:23.151974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac75c3a-d274-4bb9-a7b3-65d127651075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:23.153587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac75c3a-d274-4bb9-a7b3-65d127651075 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.153872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac75c3a-d274-4bb9-a7b3-65d127651075 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.154155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac75c3a-d274-4bb9-a7b3-65d127651075 None admin] PATH_INFO: `/v3/system/users/4d0b7a1fdbd24d538b6393f171990f1b/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.155609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac75c3a-d274-4bb9-a7b3-65d127651075 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d0b7a1fdbd24d538b6393f171990f1b, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:23.157047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac75c3a-d274-4bb9-a7b3-65d127651075 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:23.167382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 156/309] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Aug 31 03:53:22 2022] PUT /identity/v3/system/users/4d0b7a1fdbd24d538b6393f171990f1b/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:23.169420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa73a6-620d-4dd8-9c41-7e9ceb8d5a08 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.169813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa73a6-620d-4dd8-9c41-7e9ceb8d5a08 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.170153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa73a6-620d-4dd8-9c41-7e9ceb8d5a08 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.172132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 157/310] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:23.178332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.178521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.178671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.188826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c517d-ef1e-49a7-93c0-ec4222691b26 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:23.201490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:23.203303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:23.228477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:23.229447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.229903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.230379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.231345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] RBAC: Adding query filter params (role.id=47d1901681864d56aa2d031fc233cb1d, user.id=da94f231e7e94779b1ead0e3adfb0a6a, scope.system=all) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:23.231848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:23.233407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:23.244833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 154/311] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Aug 31 03:53:23 2022] GET /identity/v3/role_assignments?user.id=da94f231e7e94779b1ead0e3adfb0a6a&scope.system=all&role.id=47d1901681864d56aa2d031fc233cb1d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:23.287132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:23.290768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 158/312] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:23.553547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:23.611306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:23.658101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34592171-f2ae-4cec-92a7-460e0784d7a9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:23.694804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:23.695806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.696269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.696754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.708181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:23.713113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:23.713970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:23.715174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 155/313] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:23.720203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:23.818240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f7f44-8368-444a-85d5-9482e19e4b15 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:23.852661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:23.853301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:23.853577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:23.853846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:23.854512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:23.854809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:23.856217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:23.864848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:23.870241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:23.980595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ad35-a366-4daa-8cea-e77250adb979 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:23.996192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:24.017982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:24.018639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:24.018956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:24.019228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] PATH_INFO: `/v3/users/877bbcdce23f43f89d234e2c032e168d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:24.020428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=877bbcdce23f43f89d234e2c032e168d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:24.022018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:24.024028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 156/315] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:23 2022] GET /identity/v3/users/877bbcdce23f43f89d234e2c032e168d => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:24.029593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:24.077718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:24.132954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692a9b-dae9-4655-a222-ec6665e71204 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:24.167462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:24.168077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:24.168353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:24.168619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:24.237118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:24.238591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:24.284577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:24.345137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 160/316] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:24.346607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:24.455258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339c221-053f-40c7-9312-be50d167d5d2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:24.490012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78753e5e-22eb-4ee8-bc83-d30c91c31709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:24.490642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753e5e-22eb-4ee8-bc83-d30c91c31709 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:24.490917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753e5e-22eb-4ee8-bc83-d30c91c31709 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:24.491181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78753e5e-22eb-4ee8-bc83-d30c91c31709 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:24.492389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78753e5e-22eb-4ee8-bc83-d30c91c31709 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:24.493908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78753e5e-22eb-4ee8-bc83-d30c91c31709 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:24.495794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 157/317] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:24 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:24.501426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:24.604582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eb8c6-a72c-4738-961c-0a7ee52f9e7b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:24.639676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:24.640288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:24.640563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:24.640858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:24.641593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] RBAC: Adding query filter params (role.id=47d1901681864d56aa2d031fc233cb1d, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd, user.id=877bbcdce23f43f89d234e2c032e168d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:24.641901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:24.643411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaa60d-a1a6-49c4-997a-270a228331cd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:24.649639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 161/318] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:24 2022] GET /identity/v3/role_assignments?user.id=877bbcdce23f43f89d234e2c032e168d&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=47d1901681864d56aa2d031fc233cb1d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:24.850082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16789-f809-44b7-aca3-62d93cde0e74 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:24.850413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16789-f809-44b7-aca3-62d93cde0e74 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:24.850622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16789-f809-44b7-aca3-62d93cde0e74 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:24.852098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 158/319] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:24.857769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff6d3d-6c7b-4b79-b555-c0b3b4a74db0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:24.858291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff6d3d-6c7b-4b79-b555-c0b3b4a74db0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:24.858751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff6d3d-6c7b-4b79-b555-c0b3b4a74db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:24.877720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-caff6d3d-6c7b-4b79-b555-c0b3b4a74db0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:24.879276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-caff6d3d-6c7b-4b79-b555-c0b3b4a74db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:24.882576 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:24.956030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 162/320] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:25.160064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4b74-1731-4eda-8d0a-eb55732ffe92 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.160407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4b74-1731-4eda-8d0a-eb55732ffe92 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.160522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4b74-1731-4eda-8d0a-eb55732ffe92 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.162009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 159/321] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:25.167326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.167833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.167833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.190125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:25.191301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:25.199035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917262c-563d-4d77-a9c2-2949516c9d5d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.199323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917262c-563d-4d77-a9c2-2949516c9d5d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.199598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917262c-563d-4d77-a9c2-2949516c9d5d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.200978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 160/322] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:53:25.205838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.206132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.206400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.224838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:25.226051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:25.262258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 163/323] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:25.263123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.281886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:25.303674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 161/324] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:25.336575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:25.368495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d401f-809f-4224-ac55-e2ad1e531b95 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:25.403114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:25.403961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.404383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.404793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.406079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:25.407677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:25.409760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 164/325] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:25.415293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.516724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fda2b-bf4a-4d8e-82f2-dde9da268de6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:25.520356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.557210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:25.558172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.558669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.559130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] PATH_INFO: `/v3/groups` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.560119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:25.561626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:25.584830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 162/326] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Aug 31 03:53:25 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:53:25.584830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.625495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:25.645331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e27ba-0441-4701-be5c-97e7c3c0d530 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:25.684935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:25.685657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.685989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.686237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.694061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:25.701856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89e621-4cd6-4f77-9b1d-85b9a2709a59 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:25.702047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:25.707023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:25.707970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:25.708951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 165/327] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:25.715852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.743616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:25.744256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.744530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.744818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.761781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:25.768161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:25.769077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:25.769916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 163/328] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:25.775592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.837556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14333c-6a42-4f1a-a1d4-769216aa9f4a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:25.880006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:25.880721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.881025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.881298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.881982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:25.882272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:25.883951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:25.895211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 166/329] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:25.901342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:25.908330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:25.913596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0a82b-b165-406a-afe0-ea7137df5a92 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:25.956262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:25.957022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:25.957395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:25.957764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:25.958723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:25.959037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:25.961199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:25.975872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 164/330] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:25.977974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:25.982163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:26.033406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c1f4d-9822-4bd1-a37a-b59847f29d67 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:26.082093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:26.082739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:26.083013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:26.083283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] PATH_INFO: `/v3/users/4d0b7a1fdbd24d538b6393f171990f1b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:26.085127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] RBAC: Authorizing `identity:get_user(user_id=4d0b7a1fdbd24d538b6393f171990f1b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:26.086581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:26.088475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 167/331] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/users/4d0b7a1fdbd24d538b6393f171990f1b => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:26.094540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:26.109223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7deb7-8481-4c03-870d-189525f2a712 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:26.152217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:26.152892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:26.153169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:26.153443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] PATH_INFO: `/v3/users/da94f231e7e94779b1ead0e3adfb0a6a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:26.154601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] RBAC: Authorizing `identity:get_user(user_id=da94f231e7e94779b1ead0e3adfb0a6a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:26.156112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:26.158326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 165/332] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:25 2022] GET /identity/v3/users/da94f231e7e94779b1ead0e3adfb0a6a => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:26.164116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:26.205195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:26.223309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19898bab-88c2-44e6-9b2b-f60ca3b16f39 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:26.258797 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:26.268322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:26.269294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:26.269766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:26.270250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:26.271272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] RBAC: Adding query filter params (role.id=0450bb9e1ea24945a740dbef97a2c837, user.id=4d0b7a1fdbd24d538b6393f171990f1b, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:26.271792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:26.273472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9d9ff-da52-4a0e-b6ae-f85379d997ca None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:26.284213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b672774-aa3e-450e-8b64-21e1c93d05c7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:26.293215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 168/333] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Aug 31 03:53:26 2022] GET /identity/v3/role_assignments?user.id=4d0b7a1fdbd24d538b6393f171990f1b&scope.system=all&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:26.324990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e62260-7e92-434e-b725-ba0395fd786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:26.325679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62260-7e92-434e-b725-ba0395fd786b None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:26.326013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62260-7e92-434e-b725-ba0395fd786b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:26.326283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62260-7e92-434e-b725-ba0395fd786b None admin] PATH_INFO: `/v3/system/users/da94f231e7e94779b1ead0e3adfb0a6a/roles/47d1901681864d56aa2d031fc233cb1d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:26.330841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62260-7e92-434e-b725-ba0395fd786b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da94f231e7e94779b1ead0e3adfb0a6a, role_id=47d1901681864d56aa2d031fc233cb1d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:26.332279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e62260-7e92-434e-b725-ba0395fd786b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:26.343562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 166/334] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Aug 31 03:53:26 2022] PUT /identity/v3/system/users/da94f231e7e94779b1ead0e3adfb0a6a/roles/47d1901681864d56aa2d031fc233cb1d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:53:27.816882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbf683-dd03-45ff-84d7-891d6b68a04b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:27.817887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbf683-dd03-45ff-84d7-891d6b68a04b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:27.818403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbf683-dd03-45ff-84d7-891d6b68a04b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:27.820199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 169/335] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:27.825942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47659574-7324-44eb-8311-d4aba7b5fe14 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:27.826782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47659574-7324-44eb-8311-d4aba7b5fe14 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:27.827252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47659574-7324-44eb-8311-d4aba7b5fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:27.857845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-47659574-7324-44eb-8311-d4aba7b5fe14 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:27.859388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47659574-7324-44eb-8311-d4aba7b5fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:27.942496 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 167/336] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:28.066382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60f706-9167-40fc-8646-5e73163323f7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.066718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60f706-9167-40fc-8646-5e73163323f7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.066936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60f706-9167-40fc-8646-5e73163323f7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.068501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 170/337] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:28.073856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdab85-87c7-49de-b8bb-a7b6c9b4a2bf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.074416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdab85-87c7-49de-b8bb-a7b6c9b4a2bf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.074880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdab85-87c7-49de-b8bb-a7b6c9b4a2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.095297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-effdab85-87c7-49de-b8bb-a7b6c9b4a2bf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:28.096818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-effdab85-87c7-49de-b8bb-a7b6c9b4a2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:28.119492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:28.192325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 168/338] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:28.369304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5621-0d06-4cd6-814e-ed5b6c0dbbc6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.369969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5621-0d06-4cd6-814e-ed5b6c0dbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.370451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5621-0d06-4cd6-814e-ed5b6c0dbbc6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.372281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 171/339] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:28.377511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.377803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.378074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.401337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:28.402528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:28.443607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5621-0d06-4cd6-814e-ed5b6c0dbbc6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:28.487520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 169/340] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:28.570451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5621-0d06-4cd6-814e-ed5b6c0dbbc6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:28.612299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:28.612970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.613248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.613518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.625539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:28.631050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:28.631955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:28.632742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 172/341] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:28.638200 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:28.669271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:28.767892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:28.807660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:28.841494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2a213-2420-4430-a474-a5cfdca96626 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:28.880544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d80e5-413c-4084-848a-df6cf5da6a6f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:28.915151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:28.916173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.916452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.916949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.918234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:28.918782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:28.921473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:28.939100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 170/342] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:28.939997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:28.958004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:28.958627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:28.958909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:28.959176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:28.976399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:28.981676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:28.982593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:28.983388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:28.985122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 173/343] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:28.986355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:29.147954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e684ae7-f0e1-43d9-95e6-e6a4c5e98546 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:29.187915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29330401-c4ce-4cd8-86dc-7dae42123f86 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:29.197146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:29.217894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:29.218542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.218826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.219095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.244531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:29.253814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:29.254785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:29.255657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 171/344] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:29.256414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:29.263098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135c365-5659-4313-967d-fffc571fd0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:29.263730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c365-5659-4313-967d-fffc571fd0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.264008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c365-5659-4313-967d-fffc571fd0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.264277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c365-5659-4313-967d-fffc571fd0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.279730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:29.407728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135c365-5659-4313-967d-fffc571fd0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:29.410746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135c365-5659-4313-967d-fffc571fd0d2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:29.466512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed364f8-4283-4996-b772-ea0068a926db None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:29.502724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:29.503351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.503630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.503901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.504667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:29.505001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:29.506580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:29.516224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 172/345] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:29.517215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:29.552638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 174/346] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:29.554116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502beee-212f-4cc0-9ae8-b8cedcfd0e54 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.554401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502beee-212f-4cc0-9ae8-b8cedcfd0e54 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.554677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502beee-212f-4cc0-9ae8-b8cedcfd0e54 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.560029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 175/347] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:29.560976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502beee-212f-4cc0-9ae8-b8cedcfd0e54 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:29.570938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:29.601264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:29.639750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6177f-2a81-4a64-9729-01a2edbf11d1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:29.681061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:29.682215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.682688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.683148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.683990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] RBAC: Adding query filter params (name=member) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:29.684462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:29.686081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9805d-2ce9-475d-9021-e58b7cda4247 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:29.702324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 173/348] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:29.702324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.702324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.702324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.707666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502beee-212f-4cc0-9ae8-b8cedcfd0e54 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:29.724295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:29.725883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:29.753782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:29.755013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.755530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.756213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.803742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 174/349] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:29.809031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:29.847514 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:29.849967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:29.861136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:29.878313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:29.936632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4263a-145c-49ef-a089-1fc6c676285e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:29.966560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 176/350] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:29.967949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:29.979572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547d45-cdb9-4068-88e2-e844ab7b71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:29.980546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547d45-cdb9-4068-88e2-e844ab7b71ef None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.980848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547d45-cdb9-4068-88e2-e844ab7b71ef None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.981126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547d45-cdb9-4068-88e2-e844ab7b71ef None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.982913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2547d45-cdb9-4068-88e2-e844ab7b71ef None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:29.985789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2547d45-cdb9-4068-88e2-e844ab7b71ef None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:29.987908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 175/351] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:29 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:29.989409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7820ec8-59e4-4f59-aee6-6012e1285019 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:29.989688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7820ec8-59e4-4f59-aee6-6012e1285019 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:29.990029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7820ec8-59e4-4f59-aee6-6012e1285019 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:29.995298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 176/352] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:29.995298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7820ec8-59e4-4f59-aee6-6012e1285019 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.107367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7820ec8-59e4-4f59-aee6-6012e1285019 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.111680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca102a-dc86-496e-adad-87c45bfc0757 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.119850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.145266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.158583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.159518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.159807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.160170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.160460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.160658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.160765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.161304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.162012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:30.163632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:30.166859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 177/353] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:29 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:30.169222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.243993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:30.245497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:30.286987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0354fb-097d-4551-92a0-b43b4a4971ee None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.325407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05e8a-eb25-40c3-a289-c71e005c7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.326407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05e8a-eb25-40c3-a289-c71e005c7c7f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.326879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05e8a-eb25-40c3-a289-c71e005c7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.327345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05e8a-eb25-40c3-a289-c71e005c7c7f None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.333618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f05e8a-eb25-40c3-a289-c71e005c7c7f None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:30.335280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f05e8a-eb25-40c3-a289-c71e005c7c7f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:30.337174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 178/354] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:30.338501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.338966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.339238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.358662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:30.359856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 177/355] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:30.359968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:30.360579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.368575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.425844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.437373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 179/356] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:30.439740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.497971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28693f0a-1e8b-4d1c-8315-cf4db75d4258 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.540331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe550e-15e6-496c-82fd-6aba23c347c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.541840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe550e-15e6-496c-82fd-6aba23c347c2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.541840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe550e-15e6-496c-82fd-6aba23c347c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.541840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe550e-15e6-496c-82fd-6aba23c347c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.555423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed4464-6039-45ab-a7f9-7f91ae44f8e7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.558033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe550e-15e6-496c-82fd-6aba23c347c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5bbe550e-15e6-496c-82fd-6aba23c347c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:30.563199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:30.564090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:30.564900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 178/357] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:30.566430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8c43-7f3d-4561-bd68-b855c99a9b3e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.566430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8c43-7f3d-4561-bd68-b855c99a9b3e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.566430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8c43-7f3d-4561-bd68-b855c99a9b3e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.567527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 179/358] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:30.568142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8c43-7f3d-4561-bd68-b855c99a9b3e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.609550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.610441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.610729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.611004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.613826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:30.615796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:30.617780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 180/359] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:30.618819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.679342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.695285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.728497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8c43-7f3d-4561-bd68-b855c99a9b3e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.746836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787bf62-8bf5-4b7d-989a-f5f76832090c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.767542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.768243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.768521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.768790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.769555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=44523f21eb3848998fd4754b45a97f2d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:30.769863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:30.771419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6b6b-9a75-4b27-8d0e-5c1bfd1a671a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:30.778405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 180/360] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:30.779597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.779873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.780141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.799535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:30.800204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:30.800478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:30.800753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:30.801382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:30.802004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:30.802732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:30.803568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:30.805752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 181/361] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:30.812901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.894842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 181/362] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:30.896195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:30.965121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa6c9b-22bc-4d2e-ab0f-11525ef41b57 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:30.972477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:30.995626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.007095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.007713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.007990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.008261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.009082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:31.009384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.010868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.023525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 182/363] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.024472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.033382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0daf5-c7a7-4376-95a2-928f41715cc0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.075314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.076310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.076923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.077393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.078436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=44523f21eb3848998fd4754b45a97f2d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:31.078942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.080711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.087258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 182/364] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:30 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.088534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.175914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cbafd-9e78-40ad-8b5a-85a54bef4980 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.214754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e556c5-ff5f-45d9-9ab2-af430ac4dde5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.226656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.227250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.227528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.227798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.241710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:31.247393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:31.248340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 183/365] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:31.249597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.251871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.267471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.268528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.271571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.271571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.272561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.275022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.280567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 183/366] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.280567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.319770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.380210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef85ba-6648-4a38-a6fb-d675fd2308cf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.402906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071440c3-a962-4e2d-b0ca-2667751f8085 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.422820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.423706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.424126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.424590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] PATH_INFO: `/v3/users/da94f231e7e94779b1ead0e3adfb0a6a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.426539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=da94f231e7e94779b1ead0e3adfb0a6a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.428732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.431205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 184/367] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/users/da94f231e7e94779b1ead0e3adfb0a6a => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.432624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.441247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.442010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.442381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.442761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.454939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:31.460663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:31.461608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:31.462569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 184/368] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:31.463536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.525547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.570045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7f37-2ba6-424f-95e6-4261627a2fb1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.579626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc539-baec-4921-8718-cc8095ef9277 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.593312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.619318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.619929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.620206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.620475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.621175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:31.621473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.621940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.622782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.622919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.623398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.623870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.624989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:31.625455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.627038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.632686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 185/369] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.633726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.634498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.635503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.758195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1854d0-e515-4c5e-8313-80927e9bd290 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.783139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.810453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f655a1-85cf-4457-8f4e-16a64c4d64ab None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.814192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.814840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.815115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.815385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.816073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:31.816378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.817837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.833067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 186/371] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.834003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.856929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.857929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.858386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.858891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:31.859858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] RBAC: Adding query filter params (role.id=47d1901681864d56aa2d031fc233cb1d, user.id=da94f231e7e94779b1ead0e3adfb0a6a, scope.system=all) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:31.860305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:31.862072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:31.876279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 186/372] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/role_assignments?user.id=da94f231e7e94779b1ead0e3adfb0a6a&scope.system=all&role.id=47d1901681864d56aa2d031fc233cb1d => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:31.880444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:31.928047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:31.950692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d44f14-9eb7-4358-bac1-8804d7c47381 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:31.985662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:31.986300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:31.988845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:31.988845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.019859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41ae78-2095-4d71-a4b5-9f63d49bc193 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.039496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:32.063442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.068831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.073708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.074602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.075149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.075588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.179374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.181295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.200337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 187/373] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:32.206683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:32.257252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:32.311187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 187/374] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:32.317396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:32.349572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:32.382954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f25c7-e317-49c3-850e-fb7ba9726040 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.426554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4319-8cca-4263-8c14-0b5b2f51dc48 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.436280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.437819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.437819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.437819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.438663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.440135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.446253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 188/375] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:32 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:32.451246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:32.469003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.470002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.470473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.470959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] PATH_INFO: `/v3/projects/7f412dcfcdac460e92b9728f91705fbb` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.472285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] RBAC: Authorizing `identity:get_project(project_id=7f412dcfcdac460e92b9728f91705fbb)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.473952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.476110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 188/376] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:32 2022] GET /identity/v3/projects/7f412dcfcdac460e92b9728f91705fbb => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:32.482087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:32.507453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:32.595108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a003b-c8f5-4640-9ee7-7e521b075d61 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.598603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b9e1c-8f1b-4d44-95bb-8d7181615993 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.631983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.632872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.633172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.633603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] PATH_INFO: `/v3/groups/27e0578c7418462a81ab54624fb6412e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.640057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] RBAC: Authorizing `identity:get_group(group_id=27e0578c7418462a81ab54624fb6412e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.641666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.643734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 189/377] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:32 2022] GET /identity/v3/groups/27e0578c7418462a81ab54624fb6412e => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:32.644282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.645025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.645308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.645583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.646811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.649835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:32.650501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.652659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 189/378] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:32 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:32.658340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:32.680593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:32.735730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:32.772237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329380-89f1-440b-b8bc-54c5539edb7d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.806759 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.807560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.807836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.808132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.808892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] RBAC: Adding query filter params (group.id=27e0578c7418462a81ab54624fb6412e, role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7f412dcfcdac460e92b9728f91705fbb) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:32.809195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.810628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27983cf-3002-49cd-9249-d732439dcae2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.817015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 190/379] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:32 2022] GET /identity/v3/role_assignments?group.id=27e0578c7418462a81ab54624fb6412e&scope.project.id=7f412dcfcdac460e92b9728f91705fbb&role.id=faea311d34554d2b9ce4434210a27c8f => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:32.827011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78531cb9-3267-487b-ac8e-708ae6d0b1f8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:32.906701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:32.907265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:32.907544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:32.907816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:32.908580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:32.908929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:32.910433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7597a-7338-45be-86f6-ee8e3bc73cd0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:32.921646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 190/380] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:32 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:33.334825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff48a5-7a1c-4e66-a7b9-6d34f95c29ab None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:33.335362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff48a5-7a1c-4e66-a7b9-6d34f95c29ab None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:33.335362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff48a5-7a1c-4e66-a7b9-6d34f95c29ab None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:33.336995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 191/381] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:33.342361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c183657-6c59-4bde-bd1c-541049fe2aed None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:33.342746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c183657-6c59-4bde-bd1c-541049fe2aed None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:33.342937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c183657-6c59-4bde-bd1c-541049fe2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:33.362916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6c183657-6c59-4bde-bd1c-541049fe2aed None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:33.364119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6c183657-6c59-4bde-bd1c-541049fe2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:33.434001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 191/382] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:33.582614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b631987-42ab-4c5f-8cd7-b5be265bf3c3 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:33.583011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b631987-42ab-4c5f-8cd7-b5be265bf3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:33.583180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b631987-42ab-4c5f-8cd7-b5be265bf3c3 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:33.584989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 192/383] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:33.590182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:33.590466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:33.590737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:33.621897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:33.623098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:33.625394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:33.709871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 192/384] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:33.858471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b631987-42ab-4c5f-8cd7-b5be265bf3c3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:33.976592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b631987-42ab-4c5f-8cd7-b5be265bf3c3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.008368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:34.015274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.016097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.016531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.016974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.030285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:34.035778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:34.036985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:34.037938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:34.039742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 193/385] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:34.045578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.052493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.176902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fd35a-1018-4e9f-9330-f0f2277387b7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.216542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.217466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.217901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.218858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.231022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:34.237394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:34.238461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:34.239450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:34.241860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 194/386] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:34.247555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.278903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad22ee-bb23-44e8-a0fc-b33edfd9c39f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.319206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.320064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.320498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.321231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.322047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:34.322736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:34.325362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:34.337499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:34.343365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 193/387] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:34.348760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.369464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:34.430160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b82e2f-03e7-4cc3-b088-c6d0a925f3d2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.468913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.470000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.470485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.470962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.471823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:34.472414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:34.473995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:34.483433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 195/388] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:34.490241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.510343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb2758-72be-4bc5-acb2-d4102e75a485 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.573565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.574225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.574493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.574765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.576081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:34.577529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:34.579417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 194/389] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:34.584525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.620090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5760f-0b03-4b70-a531-c4e5b6c2e739 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.639868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:34.668706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26040530-09e9-4553-b60e-113c7c3c87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.669843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26040530-09e9-4553-b60e-113c7c3c87bf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.670372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26040530-09e9-4553-b60e-113c7c3c87bf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.671151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26040530-09e9-4553-b60e-113c7c3c87bf None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.672705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26040530-09e9-4553-b60e-113c7c3c87bf None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:34.674380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26040530-09e9-4553-b60e-113c7c3c87bf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:34.676484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 196/390] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:34.677828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc007-acf2-4a8b-a717-d2b46ac019d5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.678272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc007-acf2-4a8b-a717-d2b46ac019d5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.678657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc007-acf2-4a8b-a717-d2b46ac019d5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.680267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 197/391] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:34.685825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febc007-acf2-4a8b-a717-d2b46ac019d5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.691968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:34.733647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef5b14-b5b0-4774-a51f-a1bbdb12a0fa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.777451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f2f5b-f586-4c1c-9475-2c3250427adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.778259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2f5b-f586-4c1c-9475-2c3250427adf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.778634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2f5b-f586-4c1c-9475-2c3250427adf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.779000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f2f5b-f586-4c1c-9475-2c3250427adf None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.780237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2f5b-f586-4c1c-9475-2c3250427adf None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:34.782464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f2f5b-f586-4c1c-9475-2c3250427adf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:34.785401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 195/392] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:34.787054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f6a2-e843-4182-9521-beed87663349 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.787428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f6a2-e843-4182-9521-beed87663349 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.787794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f6a2-e843-4182-9521-beed87663349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.810432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febc007-acf2-4a8b-a717-d2b46ac019d5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:34.811763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4878f6a2-e843-4182-9521-beed87663349 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:34.814240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4878f6a2-e843-4182-9521-beed87663349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:34.849694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:34.850566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:34.850977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:34.851382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:34.852719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:34.854466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:34.856671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 198/393] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:34 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:34.857650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.900059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 196/394] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:34.901190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f6a2-e843-4182-9521-beed87663349 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:34.939737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:35.021241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:35.037181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab38f4-c34c-40e1-a35d-bcd465b51203 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:35.087059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f6a2-e843-4182-9521-beed87663349 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:35.102325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50280d-afc9-449b-b46a-ac782e5a6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:35.102987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50280d-afc9-449b-b46a-ac782e5a6125 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.103261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50280d-afc9-449b-b46a-ac782e5a6125 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.103527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50280d-afc9-449b-b46a-ac782e5a6125 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.106578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50280d-afc9-449b-b46a-ac782e5a6125 None admin] RBAC: Authorizing `identity:create_grant(project_id=44523f21eb3848998fd4754b45a97f2d, group_id=60bce6f3ae024b74b67100e9e7362f8b, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:35.108759 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50280d-afc9-449b-b46a-ac782e5a6125 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:35.126372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 199/395] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Aug 31 03:53:34 2022] PUT /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:35.153458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fe3f2-ea4c-4ed8-a423-391378d0db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:35.154197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe3f2-ea4c-4ed8-a423-391378d0db19 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.154478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe3f2-ea4c-4ed8-a423-391378d0db19 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.154752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe3f2-ea4c-4ed8-a423-391378d0db19 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.160156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fe3f2-ea4c-4ed8-a423-391378d0db19 None admin] RBAC: Authorizing `identity:create_grant(project_id=44523f21eb3848998fd4754b45a97f2d, group_id=60bce6f3ae024b74b67100e9e7362f8b, role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:35.161815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fe3f2-ea4c-4ed8-a423-391378d0db19 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:35.187356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 197/396] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Aug 31 03:53:34 2022] PUT /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:35.224623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f269-50aa-4472-a5de-1171d101b313 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.224958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f269-50aa-4472-a5de-1171d101b313 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.225249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f269-50aa-4472-a5de-1171d101b313 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.226908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 200/397] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:35.233551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.233914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.234096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.237515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f269-50aa-4472-a5de-1171d101b313 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:35.266005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:35.267243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:35.386621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 198/398] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:35.410917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f269-50aa-4472-a5de-1171d101b313 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:35.423660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:35.450259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ca374-bd22-4d22-8ea4-8568a0b32515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:35.450946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ca374-bd22-4d22-8ea4-8568a0b32515 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.451229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ca374-bd22-4d22-8ea4-8568a0b32515 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.451507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ca374-bd22-4d22-8ea4-8568a0b32515 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.462645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ca374-bd22-4d22-8ea4-8568a0b32515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d99ca374-bd22-4d22-8ea4-8568a0b32515 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:35.468040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:35.469036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:35.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 201/399] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:35.477067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:35.502122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02407c8-efe4-4cd2-b71d-db9b528b90b5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.502713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02407c8-efe4-4cd2-b71d-db9b528b90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.502980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02407c8-efe4-4cd2-b71d-db9b528b90b5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.504575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 202/400] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:35.509908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.510185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.510458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.529330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:35.530515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:35.594444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:35.648319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded91b7e-a779-4f86-85b5-fac67fb81dde None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:35.662255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 203/401] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:35.709512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:35.710142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.710417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.710686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.711362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:35.711663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:35.713080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:35.721831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 199/402] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:35.728011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:35.731282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:35.895335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:35.899713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426017b6-1afe-4d16-bd25-1e9174dff490 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:35.917647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511dbc7-7415-45e7-b40e-585452e3e385 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:35.943680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:35.969528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:35.970161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.970430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.970698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.972186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:35.973653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:35.978577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:35.979152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:35.979424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:35.979690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:35.980556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 204/403] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:35 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:35.984295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:35.995811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:36.001639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:36.002832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:36.003646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 200/404] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:36.004298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.115914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766b87e-d8c5-4767-95a4-5aeba74cdc25 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.142457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e4432-e395-4678-90e5-e2e39fcae97f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.152779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.153542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.153813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.154077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.155261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.156686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.158863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 205/405] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:35 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:36.159626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.182887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.183576 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.183970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.184301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.198974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:36.202335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:36.206803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:36.207725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:36.209666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 201/406] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:36.211418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.270032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:36.285867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e537-f6f6-48b6-ac34-26d067d2c80b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.325989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.326600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.326876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.327141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.327804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:36.328099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.329491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.338359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 206/407] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:36.339195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.345194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636914b4-0ed7-4171-a7b1-2f72b98a9b24 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.383150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.383816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.384088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.384354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.386549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] RBAC: Authorizing `identity:create_grant(project_id=4648e1b848a24ba2b01b8dde293e33cd, group_id=60bce6f3ae024b74b67100e9e7362f8b, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.388056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.409151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 202/408] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Aug 31 03:53:36 2022] PUT /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:36.410368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.444280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:36.449015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084d022-2e28-4334-884f-ce3b2dcc2c20 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.488012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.488674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.488986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.489260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.490032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:36.490342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.491743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.501766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 207/409] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:36.508175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.529122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:36.533445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd0b4-07a5-4b3c-85e1-f78abd7fa36e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.572902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.574076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.574471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.574746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] PATH_INFO: `/v3/groups/27e0578c7418462a81ab54624fb6412e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.576080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] RBAC: Authorizing `identity:get_group(group_id=27e0578c7418462a81ab54624fb6412e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.578235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.580074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 203/410] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/groups/27e0578c7418462a81ab54624fb6412e => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:36.585855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.671460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501bfdb-433a-4331-86fc-f42f99b58c08 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.712936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.713585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.713863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.714138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.715290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.716730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.718609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 208/411] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:36.722307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237761-954c-4790-8649-5941b2ab4377 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.724075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.758754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:36.764510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.765379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.765804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.766223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] PATH_INFO: `/v3/projects/7f412dcfcdac460e92b9728f91705fbb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.768488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] RBAC: Authorizing `identity:get_project(project_id=7f412dcfcdac460e92b9728f91705fbb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.770100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.772230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 204/412] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/projects/7f412dcfcdac460e92b9728f91705fbb => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:36.779001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.819473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:36.861493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac699-342b-41ec-a655-b15a9d77cda0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.895361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a3e86-bb38-467f-b4da-b4a2d146c29f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:36.914740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.915646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.915923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.916951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.919751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.921558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:36.923235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 209/413] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:36 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:36.934115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:36.971545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf7c79-1103-41a1-94e7-c0d689cdfb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:36.972272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7c79-1103-41a1-94e7-c0d689cdfb75 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:36.972553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7c79-1103-41a1-94e7-c0d689cdfb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:36.972836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf7c79-1103-41a1-94e7-c0d689cdfb75 None admin] PATH_INFO: `/v3/projects/7f412dcfcdac460e92b9728f91705fbb/groups/27e0578c7418462a81ab54624fb6412e/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:36.976217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf7c79-1103-41a1-94e7-c0d689cdfb75 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f412dcfcdac460e92b9728f91705fbb, group_id=27e0578c7418462a81ab54624fb6412e, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:36.977920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf7c79-1103-41a1-94e7-c0d689cdfb75 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:37.002931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 205/414] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Aug 31 03:53:36 2022] PUT /identity/v3/projects/7f412dcfcdac460e92b9728f91705fbb/groups/27e0578c7418462a81ab54624fb6412e/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:53:37.085611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:37.092909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4affbc5-d48f-4fd4-b90b-711a97c3111d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:37.137814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5badce-c8d6-4cdf-ad43-472f553a4213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:37.138487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5badce-c8d6-4cdf-ad43-472f553a4213 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:37.138762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5badce-c8d6-4cdf-ad43-472f553a4213 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:37.139033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5badce-c8d6-4cdf-ad43-472f553a4213 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:37.141282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5badce-c8d6-4cdf-ad43-472f553a4213 None admin] RBAC: Authorizing `identity:create_grant(project_id=4648e1b848a24ba2b01b8dde293e33cd, group_id=60bce6f3ae024b74b67100e9e7362f8b, role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:37.142743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5badce-c8d6-4cdf-ad43-472f553a4213 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:37.158131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 210/415] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Aug 31 03:53:36 2022] PUT /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd/groups/60bce6f3ae024b74b67100e9e7362f8b/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:37.399099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187fc82-9474-4a35-9bc8-cab2f391e74f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:37.399586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187fc82-9474-4a35-9bc8-cab2f391e74f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:37.399586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187fc82-9474-4a35-9bc8-cab2f391e74f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:37.401048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 206/416] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:37.402391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b08f79-8ad7-4a91-9f4f-cfdea808ba65 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:37.402743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b08f79-8ad7-4a91-9f4f-cfdea808ba65 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:37.403016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b08f79-8ad7-4a91-9f4f-cfdea808ba65 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:37.404584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 211/417] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:37.407348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:37.407629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:37.407904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:37.418152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:37.418437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:37.418690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:37.429176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:37.430380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:37.449582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:37.450791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:37.540000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 207/418] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:37.569928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 212/419] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:37.883829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:37.898582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:37.908556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:37.989261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:38.007730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178eb53e-a573-4885-add6-067e8e509ba9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.057914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.058614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.058896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.059163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.069995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:38.074840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:38.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 213/420] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:38.081604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:38.086670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7447c-5fe3-4699-97e1-9c349934dd50 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.160826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.160826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.160826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.160826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.166527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:38.171694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:38.172657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:38.173482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:38.177377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 208/421] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:38.179130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:38.269755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f7a89-1a13-40bf-ac88-6aee3d8b1e53 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.277479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:38.294357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26003-355d-42a4-8c76-79f12e99e24a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.330584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.331345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.331690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.332037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.332932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:38.333307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:38.334858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:38.348583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 209/422] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:38.350127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:38.360137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.360765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.361074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.361344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.362025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:38.362323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:38.363751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:38.384421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 214/423] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:38.389897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:38.410949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:38.456790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4296eb-8ecd-406e-b5a9-3b42bf3ffa78 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.492770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.493443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.493725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.494000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.511678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:38.566281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:38.567676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:38.619542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1ede-580f-4df4-9dac-b31602c4b408 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.673559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 210/424] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:53:38.675247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:38.685500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.686481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.686966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.687518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.729245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:38.785520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2854f-52dd-46af-a55b-f1e94fe15ff1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:38.821378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:38.822090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:38.822375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:38.822649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:38.823779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:38.824320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:38.825317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:38.826225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:38.834183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 211/425] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:38.834183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:38.849825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:38.961476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 215/426] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:53:38.970149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.083574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635f60e-d2cb-4cfc-9d59-0eb7181c3413 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:39.088235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d5370-dac9-45f1-9006-f393d83fd688 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:39.098222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:39.103680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:39.125961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00be513-36f5-4184-a015-de3f5051dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:39.126606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be513-36f5-4184-a015-de3f5051dbdf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.126882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be513-36f5-4184-a015-de3f5051dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.126983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:39.127154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be513-36f5-4184-a015-de3f5051dbdf None admin] PATH_INFO: `/v3/projects/44523f21eb3848998fd4754b45a97f2d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.127866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.128248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.128523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.128620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00be513-36f5-4184-a015-de3f5051dbdf None admin] RBAC: Authorizing `identity:get_project(project_id=44523f21eb3848998fd4754b45a97f2d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:39.129737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:39.130060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00be513-36f5-4184-a015-de3f5051dbdf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:39.131236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:39.132041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 216/427] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/projects/44523f21eb3848998fd4754b45a97f2d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:39.133227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474d4c-a6ae-45c3-95f3-81c645c6ba83 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.133498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474d4c-a6ae-45c3-95f3-81c645c6ba83 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.133769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474d4c-a6ae-45c3-95f3-81c645c6ba83 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.134942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 217/429] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:39.136948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c474d4c-a6ae-45c3-95f3-81c645c6ba83 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.137681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 212/429] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:38 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:39.139390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.245493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a06c-d3e6-4560-95ef-f92aed19a8b6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:39.246303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c474d4c-a6ae-45c3-95f3-81c645c6ba83 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:39.282125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed23bb-9ba1-48af-842c-96abac471205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:39.282489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:39.282769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed23bb-9ba1-48af-842c-96abac471205 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.283048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed23bb-9ba1-48af-842c-96abac471205 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.283151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.283316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed23bb-9ba1-48af-842c-96abac471205 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.283415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.283641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.284430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed23bb-9ba1-48af-842c-96abac471205 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:39.284695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=44523f21eb3848998fd4754b45a97f2d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:39.285038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:39.285887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed23bb-9ba1-48af-842c-96abac471205 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:39.286517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32195c-285f-4440-b1b7-8ca934cd4e53 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:39.287615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 218/430] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:39 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:39.288709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df40ea-a273-4bfa-ba33-504ab75beca0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.289008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df40ea-a273-4bfa-ba33-504ab75beca0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.289275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df40ea-a273-4bfa-ba33-504ab75beca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.293448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 213/431] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:39 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:39.302469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2ed05-2d68-4795-ac4f-0d8f858d31fa None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.302752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2ed05-2d68-4795-ac4f-0d8f858d31fa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.303028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2ed05-2d68-4795-ac4f-0d8f858d31fa None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.304402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 214/432] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:39.305293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2ed05-2d68-4795-ac4f-0d8f858d31fa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.315300 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-67df40ea-a273-4bfa-ba33-504ab75beca0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:39.316520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-67df40ea-a273-4bfa-ba33-504ab75beca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:39.375509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:39.391340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:39.395247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 219/433] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:39.405189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42e60-6854-43c8-85dc-2eca78db3b46 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.405649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42e60-6854-43c8-85dc-2eca78db3b46 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.405933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42e60-6854-43c8-85dc-2eca78db3b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.435836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0eb42e60-6854-43c8-85dc-2eca78db3b46 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:39.437072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0eb42e60-6854-43c8-85dc-2eca78db3b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:39.443120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2ed05-2d68-4795-ac4f-0d8f858d31fa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:39.492775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:39.493559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.493720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.493961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.494702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=44523f21eb3848998fd4754b45a97f2d) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:39.495011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:39.496501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139569f9-13fd-43ae-808d-ef2f4c3cf5b9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:39.503649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 215/434] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:39 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=44523f21eb3848998fd4754b45a97f2d&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:39.533947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 220/435] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:39.541400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22002d8-d08d-44b2-bec2-0dfe9647b45c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.541400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22002d8-d08d-44b2-bec2-0dfe9647b45c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.541400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22002d8-d08d-44b2-bec2-0dfe9647b45c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.541400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 216/436] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:39.551025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.551025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.551025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.569390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:39.570964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:39.642014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 221/437] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:39.691252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22002d8-d08d-44b2-bec2-0dfe9647b45c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.814244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22002d8-d08d-44b2-bec2-0dfe9647b45c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:39.825966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:39.830977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.857616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:39.857616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:39.857616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:39.857616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:39.869798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:39.875272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:39.876433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 03:53:39.877743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:39.878980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:39.879535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 217/438] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:39.885977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:39.960867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b98b8-e370-42b0-8c80-442b3a5c32c7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.003577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71dec7-f43b-4566-b94f-390b9184fa31 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.003785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.004421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.004701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.005065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.017520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:40.022474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:40.023488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:40.024284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 222/439] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:40.029264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.046594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f840056-0964-4441-8400-791afef73eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.047206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f840056-0964-4441-8400-791afef73eec None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.047478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f840056-0964-4441-8400-791afef73eec None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.047743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f840056-0964-4441-8400-791afef73eec None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.048407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f840056-0964-4441-8400-791afef73eec None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:40.048708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f840056-0964-4441-8400-791afef73eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.050110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f840056-0964-4441-8400-791afef73eec None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.059343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 218/440] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:53:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:40.060407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f840056-0964-4441-8400-791afef73eec None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.105704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.138428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.145721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4736e-c3f9-4c48-aa72-32fad42607f2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.176511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f840056-0964-4441-8400-791afef73eec None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.178614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.179006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.179280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.179547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.189895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:40.194703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:40.195565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:40.196372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 223/441] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:40.197087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.212240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.212833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.213111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.213390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.214043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:40.214343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.215714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.223631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 219/442] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:40.224442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.295430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7770f-d7ab-4c79-91e4-605bcb474759 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.319789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.326586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4312d-c0f0-43ab-88df-a520f9da3f2a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.330145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.330754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.331030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.331297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.354573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.359540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.360155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.360423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.360693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.361390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:40.361697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.363062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.370938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 220/443] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:40.371724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.402686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.404121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.471285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02c034-119d-4ed0-aaad-6665aee97578 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.500381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 224/444] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:40.501248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.505085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.505734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.506019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.506293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.530615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.556855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.584324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.585853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.600739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31e81-c742-440c-bec0-f5f84c51b81a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.636408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.637033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.637309 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.637573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.681806 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 221/445] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:40.682768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.710438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.711913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.736660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.774330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.781192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa696-da14-4d39-b4c1-dcb511f77e08 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.814982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.815614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.815889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.816150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.817297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.819471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 225/446] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:40.820316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.821092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.822710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 222/447] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:40.825338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.925905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696b29-7209-45e2-bfc2-6c71eeadedc2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.928829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a58600-e7d1-4833-898e-5d33e8706632 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:40.951652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:40.959889 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.960518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.960812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.961098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] PATH_INFO: `/v3/projects/4648e1b848a24ba2b01b8dde293e33cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.962106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:40.962209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] RBAC: Authorizing `identity:get_project(project_id=4648e1b848a24ba2b01b8dde293e33cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.962737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:40.963015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:40.963284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] PATH_INFO: `/v3/projects/7f412dcfcdac460e92b9728f91705fbb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:40.963622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.964392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] RBAC: Authorizing `identity:get_project(project_id=7f412dcfcdac460e92b9728f91705fbb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:40.965295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 226/448] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/projects/4648e1b848a24ba2b01b8dde293e33cd => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:40.965853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:40.966053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.971650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 223/449] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/projects/7f412dcfcdac460e92b9728f91705fbb => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:40.971650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:40.994705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:41.068130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68701592-226b-4bc6-a2b3-f8a6c347704d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:41.072686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b6ca-4da5-42c1-beec-51882e42118c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:41.101628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:41.102255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:41.102535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:41.102805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:41.103897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:41.105402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:41.105495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:41.106101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:41.106373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:41.106639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] PATH_INFO: `/v3/groups/60bce6f3ae024b74b67100e9e7362f8b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:41.106967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 224/450] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:41.107725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:41.113736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] RBAC: Authorizing `identity:get_group(group_id=60bce6f3ae024b74b67100e9e7362f8b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:41.115118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:41.116705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 227/451] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:40 2022] GET /identity/v3/groups/60bce6f3ae024b74b67100e9e7362f8b => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:41.117450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:41.177979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:41.217161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:41.227117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5117-8135-46c1-9455-67a0c669fdc1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:41.227622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f4a0-e46c-42d8-bcf6-f125a0005194 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:41.261832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:41.262028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:41.262432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:41.262574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:41.262772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:41.262885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:41.262985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:41.263057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] PATH_INFO: `/v3/groups/27e0578c7418462a81ab54624fb6412e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:41.263644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:41.263942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:41.264044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] RBAC: Authorizing `identity:get_group(group_id=27e0578c7418462a81ab54624fb6412e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:41.265408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:41.265515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:41.267040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 225/452] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Aug 31 03:53:41 2022] GET /identity/v3/groups/27e0578c7418462a81ab54624fb6412e => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:41.267819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:41.274144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 228/453] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:41 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:41.274938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:41.384401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66ac4f-39aa-4c1f-a59a-d8838a1b99d6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:41.399294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cead1a5-5298-4a84-aa85-89a78c1a9fbc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:41.413431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:41.423758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:41.424197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:41.424466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:41.424733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:41.425493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] RBAC: Adding query filter params (group.id=60bce6f3ae024b74b67100e9e7362f8b, role.id=0450bb9e1ea24945a740dbef97a2c837, scope.project.id=4648e1b848a24ba2b01b8dde293e33cd) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:41.425791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:41.427298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0ff23-262f-4388-b039-c9d21536d6fd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:41.434050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 226/454] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:41 2022] GET /identity/v3/role_assignments?group.id=60bce6f3ae024b74b67100e9e7362f8b&scope.project.id=4648e1b848a24ba2b01b8dde293e33cd&role.id=0450bb9e1ea24945a740dbef97a2c837 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:41.440162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:41.440786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:41.441132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:41.441403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:41.442152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] RBAC: Adding query filter params (group.id=27e0578c7418462a81ab54624fb6412e, role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7f412dcfcdac460e92b9728f91705fbb) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:41.442460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:41.443929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6714-8637-49c9-bc92-6ed646e8af36 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:41.451724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 229/455] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Aug 31 03:53:41 2022] GET /identity/v3/role_assignments?group.id=27e0578c7418462a81ab54624fb6412e&scope.project.id=7f412dcfcdac460e92b9728f91705fbb&role.id=faea311d34554d2b9ce4434210a27c8f => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:43.994809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c70380-728d-45d4-bb9a-fff93f1ae7e7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:43.995323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c70380-728d-45d4-bb9a-fff93f1ae7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:43.995323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c70380-728d-45d4-bb9a-fff93f1ae7e7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:43.996932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 227/456] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:44.003388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd28d3-748d-4155-89be-446d127e105e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.004184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd28d3-748d-4155-89be-446d127e105e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.004653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd28d3-748d-4155-89be-446d127e105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.030072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-bfdd28d3-748d-4155-89be-446d127e105e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:44.031551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bfdd28d3-748d-4155-89be-446d127e105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:44.048467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:44.129472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 230/457] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:44.248517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545a720-b950-4037-bbab-534fe128947c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.248696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545a720-b950-4037-bbab-534fe128947c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.249004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545a720-b950-4037-bbab-534fe128947c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.250610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 228/458] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:44.256019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83e2b6-82c6-4db5-beea-21968919e3d3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.256304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83e2b6-82c6-4db5-beea-21968919e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.256578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83e2b6-82c6-4db5-beea-21968919e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.281847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1b83e2b6-82c6-4db5-beea-21968919e3d3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:44.283102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1b83e2b6-82c6-4db5-beea-21968919e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:44.367456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 231/459] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:44.474585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545a720-b950-4037-bbab-534fe128947c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:44.598437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545a720-b950-4037-bbab-534fe128947c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:44.642263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:44.642951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.643228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.643496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.654056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:44.655519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:44.662644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f855c-3458-46c6-9108-7c4783ef2454 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.663140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f855c-3458-46c6-9108-7c4783ef2454 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.663560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f855c-3458-46c6-9108-7c4783ef2454 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.665299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 232/460] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:44.675011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:44.676082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:44.677172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:44.677172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:44.677172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:44.680249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 229/461] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:44.681975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.682494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.682959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.687324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:44.712164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:44.713716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:44.761182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:44.818634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 233/462] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:44.820854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:44.826146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf212c5-e300-44df-ad5b-f8775eb0ca36 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:44.842405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:44.873550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:44.874555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:44.874880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:44.875158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:44.875808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:44.876111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:44.877976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:44.892397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 230/463] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:44.898751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.017745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15bbe4-db95-496e-83ff-a2a558649178 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.019244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74321f6b-d72a-4d41-bd08-aae3281894c3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.022939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.055781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.056766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.057258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.057767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.062941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded9ac-1f46-401d-9ca9-db20f6af0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.063543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded9ac-1f46-401d-9ca9-db20f6af0a0f None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.063817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded9ac-1f46-401d-9ca9-db20f6af0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.064083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded9ac-1f46-401d-9ca9-db20f6af0a0f None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.064727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded9ac-1f46-401d-9ca9-db20f6af0a0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.066183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded9ac-1f46-401d-9ca9-db20f6af0a0f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.070584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.072437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.095413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 231/464] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:44 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:45.096437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:45.097368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:45.098218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:45.098218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:45.098218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:45.099569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4d23a-86f2-44fb-9598-fa8898a156e1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.100065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4d23a-86f2-44fb-9598-fa8898a156e1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.100520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4d23a-86f2-44fb-9598-fa8898a156e1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.102475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 232/466] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:45.102613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 234/466] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:45.103995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.108574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.109192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.109685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.129911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:45.131656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:45.186822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.212945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 233/467] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:53:45.214227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.269538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4396e0a-5a66-4b48-9b49-2be12b41b79b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.313853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.315356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.315810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.316548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.317391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:45.318127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.320632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f7636-20ec-4c30-bd7f-b4c10bd39d04 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.337909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 235/468] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:45.338414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1001a-62e1-432b-8672-3bc0c64fd151 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.338702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1001a-62e1-432b-8672-3bc0c64fd151 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.338972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1001a-62e1-432b-8672-3bc0c64fd151 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.340305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 236/469] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:45.345249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.345393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1001a-62e1-432b-8672-3bc0c64fd151 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.357824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf23d82-8bca-4e32-831f-c7da5fd12cf4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.402205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.402770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.403046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.403316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.414897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.416370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e506e892-4582-41bb-a5f6-31af3900d746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:45.436353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:45.437343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:45.438186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:45.438186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:45.438186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:45.438186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 234/470] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:45.439061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.439348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.439615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.462701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:45.463941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:45.465299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1001a-62e1-432b-8672-3bc0c64fd151 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.492963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.511625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.512242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.512937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.513214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.514363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.515756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.537893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 235/471] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:45.538784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.539441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 237/472] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:45 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:45.540268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.637060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.673346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02f81d-1e4d-4f08-b3ef-f02b3435a96f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.716581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.717250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.717648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.717919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.718563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:45.718857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.720411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.726113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4eac2-afbd-4529-8ed0-e54ef07fcd86 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.741934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 236/473] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:45.747985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.777528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.778193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.778528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.778800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.794024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.796551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:45.814570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:45.815509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:45.816357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:45.816357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:45.816357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:45.816518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 238/474] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:45.822655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.861691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.873158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724eee-0573-424f-97ab-7c5addc5bc74 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:45.903827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:45.909301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:45.909882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:45.910347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:45.910937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:45.911775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:45.913414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:45.941442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 237/475] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:45 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:45.942513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:45.970495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ce96-3bf7-412f-87b4-567b87f99f3f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:46.021826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:46.024252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:46.024678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:46.025141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:46.025935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:46.026452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:46.028022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:46.052328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 239/476] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:46.053584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:46.060179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b87f8-4168-498a-a2f9-d27dd3737243 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:46.108192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:46.109124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:46.109544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:46.109984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:46.111334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:46.113369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:46.126024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.sql.core [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 03:53:46.126024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 03:53:46.126024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [parameters: {'id': '7eb2a3df91004de69bb66609efd3cc48', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 03:53:46.126024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81522) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application conn.query(q) Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result.read() Aug 31 03:53:46.149231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 03:53:46.150347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application next(self.gen) Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application yield resource Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application next(self.gen) Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise self.value Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application session.commit() Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 03:53:46.151421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.session.flush() Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application compat.raise_( Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 03:53:46.153404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 03:53:46.155627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application conn.query(q) Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application result.read() Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 03:53:46.157930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [parameters: {'id': '7eb2a3df91004de69bb66609efd3cc48', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:46.160700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 03:53:46.163446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:46.165905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 238/477] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Aug 31 03:53:45 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:46.165905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:46.166866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:46.173086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f47f8d-9177-43fe-aa23-cbd6c566ad9c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:46.237756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:46.238315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:46.238787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:46.239063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:46.239758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:46.241475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:46.247828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:46.282557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 240/478] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:46 2022] POST /identity/v3/users => generated 249 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:46.321105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bc3a1-150c-42bd-9052-628c05fbdb8c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:46.372152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3040-77ce-4163-8031-31d6cbfb9318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:46.372834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3040-77ce-4163-8031-31d6cbfb9318 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:46.373154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3040-77ce-4163-8031-31d6cbfb9318 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:46.373433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3040-77ce-4163-8031-31d6cbfb9318 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:46.387543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3040-77ce-4163-8031-31d6cbfb9318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-46cc3040-77ce-4163-8031-31d6cbfb9318 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:46.393244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:46.394165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:46.394979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 239/479] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:53:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:46.400208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:46.510126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca3a89-4fd9-4e78-8b43-40bf1f55a7bd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:46.544533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:46.545552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:46.546044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:46.546507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:46.547369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:46.547873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:46.549465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e950-7e9e-40fe-a772-de713c2a292c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:46.558703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 241/480] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:47.560539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a669-b3a1-4c0e-a1b0-4f097c8dd878 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:47.561079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a669-b3a1-4c0e-a1b0-4f097c8dd878 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:47.561079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a669-b3a1-4c0e-a1b0-4f097c8dd878 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:47.562710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 240/481] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:47.568017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6d00b-40f0-4f85-979d-0b30ff9f95bd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:47.568410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6d00b-40f0-4f85-979d-0b30ff9f95bd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:47.568574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6d00b-40f0-4f85-979d-0b30ff9f95bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:47.585357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:47.593742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-90f6d00b-40f0-4f85-979d-0b30ff9f95bd None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:47.594956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-90f6d00b-40f0-4f85-979d-0b30ff9f95bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:47.679604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 242/482] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:47.864142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68ff1-715e-4f53-a4b0-bf14b8268377 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:47.864879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68ff1-715e-4f53-a4b0-bf14b8268377 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:47.865356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68ff1-715e-4f53-a4b0-bf14b8268377 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:47.867145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 241/483] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:47.872112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:47.872395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:47.872667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:47.896298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:47.897517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:47.977815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a68ff1-715e-4f53-a4b0-bf14b8268377 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.007321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 243/484] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:48.106228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a68ff1-715e-4f53-a4b0-bf14b8268377 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.127027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:48.156502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:48.157170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.157447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.157717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.175644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:48.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:48.181915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:48.183150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 242/485] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:48.189908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.286010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:48.303956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.327835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d4d32-4724-4ddd-9e66-a6666c447ec9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.369058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:48.369683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.369961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.370233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.370917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:48.371219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:48.372604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:48.387256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 244/486] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:48.394694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.465349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a589d-e9be-489b-b5cf-e3cfa09eeff5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.499308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:48.499939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.500213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.500483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.511625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:48.516882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:48.517762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:48.519007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 243/487] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:48.525836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.546256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421b700-7919-44c1-a0c7-10ffcf5e86a6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.573182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:48.574689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:48.585474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:48.586355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.586811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.587223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.598445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:48.600132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-093d97d3-28f2-4de5-aa69-278e54dde7ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:48.614959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:48.616040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:48.617052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:48.617052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:48.617052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:48.623357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 245/488] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:48.624820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4412-919e-43ba-b534-0ae8a95a8730 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.625420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4412-919e-43ba-b534-0ae8a95a8730 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.625832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4412-919e-43ba-b534-0ae8a95a8730 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.627824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 246/489] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:48.632549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4412-919e-43ba-b534-0ae8a95a8730 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.645960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922bb6-4855-4a44-bc94-249b2b31c540 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.701162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:48.701162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.701162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.701162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.701549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:48.701549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:48.705086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fecfa3-91e7-4927-a01e-a98300b4e891 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:48.714262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 244/490] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:48.715513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.715805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.716050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.735629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:48.736842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:48.766633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4412-919e-43ba-b534-0ae8a95a8730 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.807531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 245/491] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:48.814418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:48.815300 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:48.815772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:48.816235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:48.816890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.817319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:48.817848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:48.819579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:48.837080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 247/492] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:48.846918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:48.862467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:48.917907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:48.974133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6d4eb-2f5a-4396-8726-dd017da74424 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:48.985918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f218d-09ca-4b4f-ba9c-6d70f31c621e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.023741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.024371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.024645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.024957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.025855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.026556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.027139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.027472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.032947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.034383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.038640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.040095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b4138406-9916-4c4d-92a7-02ac8110c180 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:49.048219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:49.049150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:49.050101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 248/493] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:49.051494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49286-bc58-4c71-9595-5337f5227646 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.051763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49286-bc58-4c71-9595-5337f5227646 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.052126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49286-bc58-4c71-9595-5337f5227646 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.057305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 249/494] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:49.058501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2a571-1b6d-47d0-b3a6-d72ec3dfc4a6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.058782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2a571-1b6d-47d0-b3a6-d72ec3dfc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:49.058889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:49.059718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:49.060558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:49.060558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:49.060558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:49.060728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2a571-1b6d-47d0-b3a6-d72ec3dfc4a6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.060817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 246/495] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:49.061356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.064512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 250/496] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:49.069947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.070227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.070497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.090371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:49.091572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:49.149776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.168643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 251/497] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:49.169447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.178749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21b0f-ca4e-40e2-a7d9-8d39436f3659 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.200694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.219355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.219971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.220249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.220523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.221290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:49.221599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.223077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b80898-b226-4df0-9c19-2ee0e0cd6bd7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.265010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 247/498] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:49.265010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.265010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.265010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.280590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:49.281815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:49.283884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f452-0684-47c9-8622-6c3e6fa61ac8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.324392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.325034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.325312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.325580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.326217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:49.326516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.327886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.341831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 252/499] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:49.347394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.353005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:49.354088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.438424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.441148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.451384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84741c6-83c7-4fef-9fe4-52a4f304bdb1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.487966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.488600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.488730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a19c4e-686d-4274-bdcc-80c22c10abac None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.488953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.489185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.499677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:49.505392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:49.506403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:49.507228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 253/501] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:49.507870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.532979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.533593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.534017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.534121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.608309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.610924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.615877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b246081-2af6-4110-8de0-cd3695b121af None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.650098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.650725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.650995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.651260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.658675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.660091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:49.671638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:49.672572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 254/502] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:49.673943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.680568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.687474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.724434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 249/503] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:49.725537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.780829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad89ea-f447-406c-ad20-08f5302e426a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.814743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.815373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.815650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.815917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.826054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:49.830135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47479c-981a-4605-a944-b51ceeeb8df1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:49.831736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:49.832743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 255/504] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:49.833623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.866487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.867104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.867379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.867649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.868340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:49.868641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.870044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:49.878231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 250/505] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:49.878923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:49.906325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.907895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:49.939406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc872eb-1c4d-4c4b-adb2-96e2e0a5f241 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.977644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:49.978185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:49.978461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:49.978726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:49.981133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a9b15-f0b2-4048-ae26-3e063c482e58 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:49.989557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:49.991019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:50.005917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:50.007028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:50.008024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:50.008024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.008024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:50.008024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 256/506] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:50.008024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.019124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.019748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.020025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.020298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.021079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:50.021385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.022823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.039877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 251/507] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Aug 31 03:53:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:50.040663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.113985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fdaa5-edd8-401c-a26d-6007ddacf250 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.121137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.137853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.138603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e54f-9ee1-4820-bd68-d9ca03c568c4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.149917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.150555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.150829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.151099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.162809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.164261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.176214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.176826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.177242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.177498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.178160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:50.178384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:50.179829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:50.181203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:50.181203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.181203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:50.181386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.181454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 257/508] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:50.181518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.181582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.192864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 252/509] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:50.193669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.294612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec13e-ba0a-48c3-8233-a3f081e5b544 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.300251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a10a-28f3-4212-8310-d6b6c98139cd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.334079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.334738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.334968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.335079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.335272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.335595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.335874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.335971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:50.336146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.336240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.337624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.346814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.348252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.349310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 253/510] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:50.350108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.358257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:50.362708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:50.363602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:50.364539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:50.364539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.364539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:50.364539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 258/511] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:50.364773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.393091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.451356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b0f3-4c3b-4b0d-b764-91fc8e763af5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.468823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb58ec-7115-467f-b490-8e475f6e26ab None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.485829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.486435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.486712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.486982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.501515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.502122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.502706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.502981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.503612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:50.503909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.505385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.516727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 259/512] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:50.517536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.553504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.554884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.562498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.602730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.617547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15b62-c95f-405d-bd9b-afceb56dcf2f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.652932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 254/513] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:50.653394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.653753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.653979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.654264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.654532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.664897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.666456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:50.680701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:50.681623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:50.682475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:50.682475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:50.682475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:50.682894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 260/514] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:50.683717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.755936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c54b-05d2-4523-bf95-2fe693bbac42 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.763292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.780029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec16173-06cb-4811-b23a-8f821ffa53c4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.790884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.791491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.791769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.792028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.792667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.794132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.815633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.815813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 255/515] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:53:50 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:53:50.816487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.816693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.816828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.817108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.817751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:50.818057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.819447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.828692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:50.835664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 261/516] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:50.836671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:50.938822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdcd10-dba9-426c-b382-fbcbaa97795a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.955479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb51509-cf18-4b7a-ad6d-b9dc534d645f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:50.977925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.978883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.979161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:50.979479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:50.987291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:50.988773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:50.996232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:50.996232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:50.996578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.000241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:51.003559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:51.004376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:51.005292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:51.005692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 256/517] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:51.006694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.013549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.015036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:51.030571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:51.031525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:51.032394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:51.032394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:51.032394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:51.032394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 262/518] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:51.032612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.038913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.085121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.123421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64ccc0-619c-4479-8022-2c52b7725f56 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.143963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e40ee-cf56-4a3f-87e5-af0b57f22960 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.158238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.159091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.159091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.159368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.160007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:51.160373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.161827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.178627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 257/519] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:51.178627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.185341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.185968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.186258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.186531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.195467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.196963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:51.208999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:51.209891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:51.210776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 263/520] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:51.211349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.265263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.285531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e63c0-297c-4fa6-b2ad-331c757fa36d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.318853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215804-383c-4103-9e84-a8840ce9ba86 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.324555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.325199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.325472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.325739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.326431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:51.326733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.328167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.331038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.350264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 258/521] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:51.350264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.365038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.365649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.365924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.366190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.366826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:51.367532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.369196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.382249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 264/522] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:51.382896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.455099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde33c-08a2-4f54-818f-3ea4b4956ac2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.487725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bcaf0-7335-4413-bf51-17829e855646 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.493307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.494143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.494585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.495044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.502762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.504399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:51.517198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:51.518072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 03:53:51.519074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:51.524519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.524519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.524519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.524519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.524870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:51.524870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.525580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 259/523] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:51.525684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.526204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.528957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.562047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 265/524] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:51.562901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.593447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.644630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeeaf5-7972-409a-948b-e1c2fb31826f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.674641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198f2ac-be51-42f9-b266-9c87a67f58e6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.687039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.687797 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.688073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.688358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.691685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=15d3488259a0490bb05a0c49688f5957) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:51.691685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.691685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.696680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 260/525] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/role_assignments?user.id=15d3488259a0490bb05a0c49688f5957&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:51.697404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.729143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.730841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.731468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.732031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.743230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.745031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:51.762706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:51.763699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:51.764529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:51.772062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 266/526] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:51.772062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.785335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.826962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f93c2d-e8e8-4777-91de-b52cac4c9242 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.862625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.863616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.864084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.864613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:51.865565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:51.866073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:51.867697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:51.880022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:51.888381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 261/527] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:51.889468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:51.897957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c94c14-e5c0-4d11-895e-a6df954377e5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:51.940535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:51.940951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:51.941233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:51.941502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.007321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79f445-c37c-4bf5-bbcd-89b9ec712d0c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.015693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.017152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.033127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.045270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.046110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.046650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.047126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.048088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:52.048556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.050276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.067647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 262/528] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:52.068847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.110284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.124656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 267/529] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:52.125694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.187857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba076ca2-dcf8-4da9-9baa-d17650c8efc0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.225505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.226228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.226603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.226938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.239819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944861-359c-4332-b7c1-954a6ea4dc4d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.276564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.277343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.277627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.278042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.278774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=e43f4bd3ff65424eb02b4261d3c3d700) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:52.279083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.280636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.284381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.289184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 268/530] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/role_assignments?user.id=e43f4bd3ff65424eb02b4261d3c3d700&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:52.290299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.302330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.303971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.350919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.405450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725a365-3585-4043-86a1-363be75bda32 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.420942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 263/531] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:52.426668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.444124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.445174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.445753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.446227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.458651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.460852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:52.477318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:52.478349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:52.479198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:52.479198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:52.479198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:52.481602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 269/532] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:52.489969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.527701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.543196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0084c3-77bc-4c50-8eda-3021a0026c04 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.594966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.595980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.597004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.597481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.618487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.620343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:52.648741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:52.649725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:52.650621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:52.650621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:52.650621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:52.657831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 264/533] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:52.663400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.694828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e8fb9-5f3a-4627-b96f-8e433d4328b2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.701709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.763105 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.763719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.764127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.764404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.765078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:52.765381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.766766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ac57-8eca-416c-a445-b348a840c3ae None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.780891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 270/534] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:52.782313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293cd3-4009-4134-92b5-31322db86401 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.782595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293cd3-4009-4134-92b5-31322db86401 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.782949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1293cd3-4009-4134-92b5-31322db86401 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.784394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 271/535] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:52.789207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293cd3-4009-4134-92b5-31322db86401 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.816647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1c17-5733-445c-b8da-5f0fe438d503 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.860871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.861837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.862343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.862805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.863638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:52.864139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.865756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464b470-dd38-4a99-941e-12bfba136233 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.868843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:52.880602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 265/536] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:52.882325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.882800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.883294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.901691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:52.903214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:52.904519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1293cd3-4009-4134-92b5-31322db86401 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:52.956493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:52.957631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:52.958083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:52.958955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:52.967656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:52.970267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:52.988829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 266/537] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:52.988829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:52.989098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:52.989898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:52.990741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 272/538] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:52.999280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.049742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:53.147812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e1ffa-5c62-4fc1-8e00-ae5cb0059821 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.183963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.184608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.184919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.185342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.192456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:53.194008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:53.196996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:53.206951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:53.208214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:53.209105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 267/539] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:53.216254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.224164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc65e8-30ef-4547-9cbe-d7384b5c0d33 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.298525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.299141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.299417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.299683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.300384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:53.300686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:53.302197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:53.323228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 273/540] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:53.327692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.372373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5904-856e-4a99-97b2-38dd251845d6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.417623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.418639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.419160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.419651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.420579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:53.421104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:53.422740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:53.437970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:53.440750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 268/541] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:53.441921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.460147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023ea2f-5bbe-41bd-94c8-de2dd70064bd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.491752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:53.509920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.510699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.511075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.511443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.522529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:53.527937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:53.529062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:53.530045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:53.536771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 274/542] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:53.537877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.564992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649765ef-940c-4917-9d72-692ba3755d96 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.603816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.604761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.605211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.605756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.606629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=5557665d603448c3bdeed0b5701e8ce2) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:53.607085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:53.608923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:53.620954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 269/543] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:53 2022] GET /identity/v3/role_assignments?user.id=5557665d603448c3bdeed0b5701e8ce2&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:53.622333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.656985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc6f06-39cf-4767-a777-62befdbfc4b7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.692829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.692829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.692829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.692829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.693301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=36e52c9271db4196a138de433b75b422) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:53.693301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:53.693918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196ad7-4b3e-453f-90eb-535c4420ef51 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:53.708890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 275/544] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:53 2022] GET /identity/v3/role_assignments?user.id=36e52c9271db4196a138de433b75b422&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:53.765850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5b07-aa3a-41f8-8ed4-5abd91e46dc9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:53.772669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec0a1-da99-47b8-b8b4-7c0af666a39f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.772989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec0a1-da99-47b8-b8b4-7c0af666a39f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.773263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec0a1-da99-47b8-b8b4-7c0af666a39f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.774921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 276/545] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:53:53.780528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.780826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.781103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.786045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:53.808420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:53.809458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:53.809912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:53.810397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:53.811284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:53.811790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:53.813492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:53.823782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 270/546] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:53.828856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:53.828856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:53.829643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:53.831206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:53.950634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 277/547] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:53.994448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbbb9d-a460-44a6-9870-8ce79510103c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.060001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.060917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.061336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.061759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.077504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:54.079203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:54.096380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:54.097379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:54.098204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:54.098204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:54.098204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:54.098204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 271/548] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:54.103954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.209051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbb44b-a4ba-44ff-bf6d-39c27c619330 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.244829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.245465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.245744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.246017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.246673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:54.246972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:54.248359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:54.255946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:54.262504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 278/549] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:54.268187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.286782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.301859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:54.405216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7289-d96e-4d43-ab99-29cd6cf3cca6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.440779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.441453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.441810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.442072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.454724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:54.460417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:54.461876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:54.462862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 279/550] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:54.472566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa7eb-5027-446e-aaff-c6ee0210b1b8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.473831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.522796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.524833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.525136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.525413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.537554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:54.539023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:54.566383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:54.567606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:53:54.568886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:54.569816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 272/551] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:54.581190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:54.582032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.609450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d2876-1201-4d43-82d0-00bb97dfbf52 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.649819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.650605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.650978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.651345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.652108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:54.652508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:54.654041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47abd-f5a2-43d0-ad1f-7702c928be14 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:54.663342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 280/552] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:54.664659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8cf69-4bbb-414f-b240-0570490f981c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.665069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8cf69-4bbb-414f-b240-0570490f981c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.665461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8cf69-4bbb-414f-b240-0570490f981c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.667009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 281/553] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:54.672562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8cf69-4bbb-414f-b240-0570490f981c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.732204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:54.750820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ca21-b2a8-43cb-b6d6-30e69efc0871 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.785146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8cf69-4bbb-414f-b240-0570490f981c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.786963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.787588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.787949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.788224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.788986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:54.789289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:54.790805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5efa-2c03-4c6e-96a2-9b5593521ef7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:54.806952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:54.815710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 273/554] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:54.818216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.818662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.819071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.823143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:54.823885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:54.824166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:54.824432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:54.837122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:54.838580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:54.840591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:54.842370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:54.853626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:54.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:54.855728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:54.855728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:54.855728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:54.855728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 282/555] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:54.855945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.916710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 274/556] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:54.917543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:54.962850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d56f89-9065-4e21-851d-846efb10b021 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:54.988089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.004931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.006006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.006482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.006976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.020116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268a8c0-0bbd-4358-a3e5-b2428008697e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.063479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.065494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.065494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.065494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.065894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.066547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:55.066846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.068654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.097071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 275/557] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:55.103019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.157972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.159456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.210397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea5265-ccdb-4e93-b3fa-73e1af5c9fe1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.240837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.246385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.247286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.247750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.248165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.256575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.258291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:55.269779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:55.271006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:53:55.272017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:55.272735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 276/558] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:55.275489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.299084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 283/559] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:53:55.299946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.374874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.395617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc5dd4-f7be-4834-85bf-e1ddd713b422 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.407711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fe3f1-1236-40d6-9492-ef27004c2834 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.432586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.433569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.434147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.434651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.444328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.444978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.445260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.445535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.446270 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:55.446577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.447063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:55.448006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:55.453108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:55.454242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:55.455249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:55.457633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 277/560] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:55.458751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.471071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 284/561] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:55.471071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.524139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.576329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a25d-6893-4222-9270-6c9adc99d84e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.576930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8134d2b-1502-4ac0-8de6-0c5e84aa14f3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.607380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.614647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.615305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.615582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.615853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.616655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:55.617003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.617688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.618390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.618817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.619430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.620108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.628237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 285/562] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:55.629120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.635008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.636908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:55.653201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:55.654216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:55.655088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:55.655088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:55.655088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:55.657409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 278/563] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:55.658530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.739820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5e39-56eb-412d-981c-a6a1bbe2570e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.773158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846db26b-32a3-436a-9ba3-f96e8cefbc1a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.776059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.777803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.778714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.779190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.779797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.793194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.795439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.811144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.811781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:55.812025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:55.812981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:55.813897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:55.813897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:55.813897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:55.814067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.814067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.816303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 286/564] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:55.817374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.830989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.832539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:55.851203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:55.852662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:55.853610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:55.853610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:55.853610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:55.853610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 279/565] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:55.853848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:55.871887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:55.935088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fbaff-1f70-4d7e-849f-1d0dca6d2130 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.972669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865a25f-83d8-464f-afeb-c3cb3e3de2f8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:55.976497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:55.977430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:55.977910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:55.978421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:55.979372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:55.979904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:55.981638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:55.996369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 287/566] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:55.998060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.010985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.011627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.011905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.012179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.012865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:56.013176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.014732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.028220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 280/567] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:56.029106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.048149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.106092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f98f1-4625-4368-937a-79d6ebd5a335 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.108754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.136284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492d137-d15c-4852-8528-fa1186d03213 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.139781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.140390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.140667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.140974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.141609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:56.141905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.143269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce81bd-db4c-4f31-97af-370aa5ccf821 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.154283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 288/568] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:56.155432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3117617-d1bd-438a-a546-c4b5bc369dc1 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.155713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3117617-d1bd-438a-a546-c4b5bc369dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.155984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3117617-d1bd-438a-a546-c4b5bc369dc1 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.157411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 289/569] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:56.157867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3117617-d1bd-438a-a546-c4b5bc369dc1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.174155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.174820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.175095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.175363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.182022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.183478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7c813e9d-05ef-4a0d-babe-94f887c593fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:56.195636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:56.197124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 281/570] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194627ff-7472-47cc-84e5-d0bd5e1334cf None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.198432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194627ff-7472-47cc-84e5-d0bd5e1334cf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.199044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194627ff-7472-47cc-84e5-d0bd5e1334cf None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.202003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 282/571] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:56.202003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194627ff-7472-47cc-84e5-d0bd5e1334cf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.267712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3117617-d1bd-438a-a546-c4b5bc369dc1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.281647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.300769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.301424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.301699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.302006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.305668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194627ff-7472-47cc-84e5-d0bd5e1334cf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.308483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.309940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-753b343f-923f-4735-b802-d35d30cd4ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:56.320972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:56.321957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:56.322864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 290/572] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:56.323626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8642a7-09d2-4dc6-bc82-9b86109f2fe9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.323879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8642a7-09d2-4dc6-bc82-9b86109f2fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.324134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8642a7-09d2-4dc6-bc82-9b86109f2fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.341843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9d8642a7-09d2-4dc6-bc82-9b86109f2fe9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:56.342015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.342550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.342893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.343038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9d8642a7-09d2-4dc6-bc82-9b86109f2fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:56.343130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.351720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.353204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.362668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:56.364682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:56.365640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:56.366784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 283/573] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:56.368373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.420650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 291/574] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:56.422005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.422290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.422557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.444043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:56.445260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:56.480554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f249a0-bb92-4a89-b6b8-3bcced3b6a5b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.518710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.519234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.519517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.519782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.520475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:56.520768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.522012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 292/575] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:56.522323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.523188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.530558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.547068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 284/576] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:56.548121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.640175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.654917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f2b3-129a-42a4-812e-9ced15ddc59b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.661643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb691-85a3-41e1-ba6a-08b9fa9b7c8d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.697110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.697724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.698003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.698271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.698961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:56.700847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.700847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.702817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.704021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.704468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.704741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.705507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:56.705809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.707234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.716912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 293/577] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:56.716912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.727067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 285/578] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:56.728010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.785689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.819990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09deb4-75ea-4557-ae9a-356a34ed79b5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.832588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b61759-6a0b-45fb-98ff-bf9e1b9bc305 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:56.852657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.853384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.853668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.853938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.854669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=844c5874363b4611b64c3ffa2dc1033c) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:56.854976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:56.856410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:56.861916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 294/579] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/role_assignments?user.id=844c5874363b4611b64c3ffa2dc1033c&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:56.862672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.866927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:56.867581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:56.867854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:56.868183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:56.874619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:56.880712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:56.885881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:56.886913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:56.887765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 286/580] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:56.888453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:56.996717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f3c5-96d5-404d-b84d-b36adfdbc268 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.012313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6436a-bdaf-4f9b-b33e-86532a4f7a3a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.027331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.036404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.037118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.037483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.037829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/15d3488259a0490bb05a0c49688f5957/roles/1879d0da387f4397abd072af56a60001` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.049414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.049985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.050257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.050768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.053643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=15d3488259a0490bb05a0c49688f5957, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.055314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.061097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.062616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.075098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 295/581] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:56 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/15d3488259a0490bb05a0c49688f5957/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:57.076230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:57.078765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:57.079770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:57.080721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:57.080721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:57.080721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:57.085070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 287/582] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:57.085894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.170673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.221317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558223d-784d-49a0-a518-779f0377db2e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.223714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7273356-5d33-4d98-a2ab-22730e9dd79e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.268541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.269104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.269236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.269488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.269757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.270463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.270892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.271302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.272109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:57.272551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.274129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.282041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:57.283712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 288/583] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:57.284785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:57.287008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:57.288109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 296/584] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:57.293695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.321135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.407926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a840d51-0cf0-4261-9b59-68f0b7b5b8cc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.420041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38930f-2973-4b77-94e4-2b48557cf5fc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.433183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.445877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.446724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.447137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.447541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.456952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.457447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.457877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.458241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.459040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:57.459459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.459774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.461058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.461530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.478256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 289/585] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:57.478256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:57.481392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:57.482483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:57.483585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:57.483585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:57.483585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:57.485396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 297/586] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:57.486339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.573009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.587284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c57a3-c8b2-4d6f-80fd-83692d4cfb05 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.594192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32817d7f-f28f-4cd3-be0a-78298ae3be03 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.624277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.625174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.625633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.625998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.626939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:57.627647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.629305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.629594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.630404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.630813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.631207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.638341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.639915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.640876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 290/587] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:57.641855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:57.654736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:57.655856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:57.656963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:57.663376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 298/588] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:57.664330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.695729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.755417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61930b-0bb4-44ae-8ccb-a6d18d38a8e2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.766826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feace2-bb81-4412-8554-5004ccd19a63 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.791830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.792593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.793084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.793455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.794281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:57.794676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.796151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.802185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.802972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.803386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.803808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.810103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 291/589] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:57.811173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.815340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.816967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.824520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:57.833795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:57.835242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:57.836306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:57.836306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:57.836306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:57.838232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 299/590] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:57.839242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.928604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052b51-15cf-4604-8941-ccf8a3570def None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.933178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:57.953264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d75fe-86db-4259-9842-4a35b9688233 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:57.970407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.971453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.972090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.972577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:57.973610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:57.974117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:57.975839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:57.989249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 292/591] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:57.990386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:57.996207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:57.996929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:57.997544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:57.997883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.007016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.008783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:58.020344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:58.021342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 300/592] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:58.023285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.071173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:58.105648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d419e-2ea4-4d1b-8299-db7eb741a9c5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.132069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeef8e-9ed7-447b-a1b9-2eb0964bf30b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.142208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.143198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.143715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.144187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.145113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:58.145714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.147392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.164794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 293/593] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:58.164794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.171202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.171878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.172153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.172422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/e43f4bd3ff65424eb02b4261d3c3d700/roles/1879d0da387f4397abd072af56a60001` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.190210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:58.193635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=e43f4bd3ff65424eb02b4261d3c3d700, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.195469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.215568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 301/594] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:58 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/e43f4bd3ff65424eb02b4261d3c3d700/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:58.216844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.313266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e79a6-959c-421c-9174-9d94fba43a85 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.379817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:58.385493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df710-3527-4bbf-b384-7452f2a0e068 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.392721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.393439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.393718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.393988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.397340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:58.397654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.399134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.428239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 294/595] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:58.433679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.440872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.441637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.442011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.442407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.450887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.452399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:53:58.465342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:58.466495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:58.467589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 302/596] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:58.471895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.546290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:58.602936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b863ee4-c4ad-4ea2-9b4b-060a2a1a6f17 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.611749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412df90-560f-4383-8151-cc8ce50e3826 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.657714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.658246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.658523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.658794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.659523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:58.659826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.661310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.671421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.672063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.672335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.672601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.695273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.696746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.703362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 303/597] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:58.714169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:58.731239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:58.732490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:58.733497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:58.733497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:58.733497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:58.734946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 295/598] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:53:58.740826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.821993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:58.882755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84bd76-b503-4cb1-a19f-c07eda21b0a9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.892743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7415b-59a7-4a88-9574-9d0b42e86ae4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:58.898391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:58.928522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.929048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:58.929508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.929716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.930080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.930559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.930971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.931376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.932165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:58.932601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.934149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc52f69-b859-474d-b557-4c53d49d06c3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.941066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:58.942705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:58.948518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 296/599] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:53:58.950146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ddaa3-d0eb-4677-96be-f2eb45f10b78 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.950569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ddaa3-d0eb-4677-96be-f2eb45f10b78 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.950974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ddaa3-d0eb-4677-96be-f2eb45f10b78 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.952541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 297/600] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:58.953488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ddaa3-d0eb-4677-96be-f2eb45f10b78 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-749efeae-dcb2-4a1c-bdce-85e25d0356a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:53:58.965873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:58.966992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:53:58.968070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:53:58.968070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:53:58.968070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:58.974420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 304/601] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:58.975834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:58.976215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:58.976588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:58.996072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:58.997504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:59.061151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.065433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ddaa3-d0eb-4677-96be-f2eb45f10b78 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.070257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 305/602] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:59.071436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.103510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.103994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.104268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.104537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.111735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.113318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:59.125124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:59.126059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:53:59.127132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 298/603] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:59.138428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.170251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.181678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874eaec-e466-494b-bc03-fdb1f610ae0f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.223224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.224346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.224770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.225379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.226592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:59.227135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.228647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8ed65-8b03-4947-a2da-077b8835989e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.242924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 306/604] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:59.244702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1cef0-aabc-4b47-8bff-b631b30304cb None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.245278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1cef0-aabc-4b47-8bff-b631b30304cb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.245793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1cef0-aabc-4b47-8bff-b631b30304cb None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.247639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 307/605] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:53:59.248934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1cef0-aabc-4b47-8bff-b631b30304cb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.273564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b913e-c275-46af-85f9-daf358a28ddb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.319360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.320023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.320308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.320581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.321628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:59.322378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.324127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b6e1a-fb05-415b-816d-a5da33df6183 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.344963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 299/606] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:59.347871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.348154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.348420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.367562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:53:59.368750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:53:59.378039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1cef0-aabc-4b47-8bff-b631b30304cb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.383553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.417036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.417781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.418060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.418334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.425520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.427459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:53:59.438771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:59.439658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:53:59.443374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:59.444457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 300/608] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:53:59.444570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 308/608] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:59.449094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.449224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.468984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.559620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a3212-63ef-4e74-b807-e8489a67b6ea None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.578613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ad715-2f9d-4bb4-9d5d-aea5ed6fe343 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.601903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.602805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.603338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.603758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/36e52c9271db4196a138de433b75b422/roles/1879d0da387f4397abd072af56a60001` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.613981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08659226-510a-438c-9c80-830b51f3936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.614646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08659226-510a-438c-9c80-830b51f3936f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.614921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08659226-510a-438c-9c80-830b51f3936f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.615189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08659226-510a-438c-9c80-830b51f3936f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.620099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=36e52c9271db4196a138de433b75b422, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.621734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.625879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08659226-510a-438c-9c80-830b51f3936f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-08659226-510a-438c-9c80-830b51f3936f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:53:59.631954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:53:59.633385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 309/609] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:53:59.634382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08659226-510a-438c-9c80-830b51f3936f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.636916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.644650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 301/610] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:59 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/36e52c9271db4196a138de433b75b422/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:53:59.654219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.713263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.747426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08659226-510a-438c-9c80-830b51f3936f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.786085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.787136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.787634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.788113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.789054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:59.789568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.791324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.800621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253827b3-32fc-4d9e-875e-d9e2b9befe7d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.806526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 310/611] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:59.807846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.839260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.839885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.840203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.840475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.841202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:53:59.841504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:53:59.843211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:53:59.852520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 302/612] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:53:59.853859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:53:59.930837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.931709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba4e4-4a06-42d7-949f-981690fb2c1a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.972067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:53:59.973182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c0e0d-0b28-42c3-b104-db81fac4aa3e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:53:59.982855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:53:59.983500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:53:59.983771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:53:59.984472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:53:59.998571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:00.005596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:00.006504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:00.007338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:00.008755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 311/613] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:00.013222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.017092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.017883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.018265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.018642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/5557665d603448c3bdeed0b5701e8ce2/roles/1879d0da387f4397abd072af56a60001` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.034583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=5557665d603448c3bdeed0b5701e8ce2, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.036249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.054214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 303/614] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:53:59 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/5557665d603448c3bdeed0b5701e8ce2/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:00.055057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.205044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff19fd8-b7dd-4c56-8064-aa6298cc9258 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.249934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a925-a7ff-4042-af41-63585fd2cc8a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.266505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.266505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.266505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.266871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.269766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:00.284588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.286911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.306999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:00.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:00.308231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:00.309636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:00.309636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:00.309636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:00.309636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 312/615] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:00.309883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.310097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.316857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.316857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:00.316857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.316857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.319027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.322231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 304/616] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:00.327455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.409181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:00.475782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf9538-d2d3-4d09-b91c-33b827e4a7fa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.486307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34557f7-5b9f-4d1a-b6af-11421c03f9ed None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.510346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.510983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.511257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.511522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.521530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.522267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.522491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.522730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.523099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.523840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:00.523960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.524422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.525964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d040de4-f6ee-4e66-9e54-870fb4c9f4db None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.538354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 313/617] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-cbca39d4-42fc-4c61-b30c-84dd40553ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:00.538510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:00.539654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:00.540725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:00.540725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:00.540725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:00.544826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 305/618] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:00.544956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314121ed-e5b7-48a7-b66d-4b3a7dca28cd None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.544956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314121ed-e5b7-48a7-b66d-4b3a7dca28cd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.544956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314121ed-e5b7-48a7-b66d-4b3a7dca28cd None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.544956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 314/619] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:00.549479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.549846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.550229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.552716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314121ed-e5b7-48a7-b66d-4b3a7dca28cd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.568191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:00.569508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:00.590271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:00.648522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 306/620] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:54:00.649428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.682479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314121ed-e5b7-48a7-b66d-4b3a7dca28cd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.707360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:00.738996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.739694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.739970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.740247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.748244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.749801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.753875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a97633-e7d0-4855-ac76-b05553ad5738 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:00.763217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:00.764308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:00.765281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 315/621] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:00.773726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.790369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.790989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.791304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.791583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.792234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:00.792625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.794077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.806810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 307/622] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:00.812072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:00.875499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:00.900885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223c3d-511f-4cf2-9600-a2748a62983c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:00.935332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:00.936047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:00.936225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:00.936446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:00.937216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:00.937513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:00.938939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:00.956666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 316/623] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:00.968435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.016146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:01.034170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044a3ce-12cb-4319-96c7-39a6cb9f592f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.069698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.070334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.070766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.071041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.080616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.082709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.089905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca51cd-d885-434b-a20c-d5383fdf9ca8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:01.096347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:01.097289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:01.098221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:01.098826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 308/624] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:01.099401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.127894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.128588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.128888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.129159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.139587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.141058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:01.155641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:01.157835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:01.159958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:01.159958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:01.159958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:01.164837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 317/625] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:01.164837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.197195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:01.231740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9213eb-45dc-4511-a87c-f4c327b280cf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.252973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:01.276253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.277593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.278266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.278729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.283593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e2e7-d193-4f3c-b0fc-899e97a1a8a0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.292372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:01.299745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:01.300691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:01.301578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:01.308840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 309/626] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:01.310128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.335742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.336725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.337054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.337328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.338268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:01.338668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.340274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.368955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 318/627] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:01.371324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.515958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bd363-e0f6-45fa-95a1-8c2ba6ab7efc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.572233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803202b-c296-4870-9fa1-8389f0b3c2f3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.589485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.590456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.590992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.591448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.592278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:01.592766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.595203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.603085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:01.621244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 310/628] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:01.622472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.654833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:01.673177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.673804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.674085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.674356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.677222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:01.678620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.680707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.705771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 319/629] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:01.707413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.788299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017201-5ec8-4c36-adc4-ffeee0aab9a5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.827434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705eb39-90c7-4d29-9235-30592b65b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.827957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705eb39-90c7-4d29-9235-30592b65b4de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.828232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705eb39-90c7-4d29-9235-30592b65b4de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.828500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705eb39-90c7-4d29-9235-30592b65b4de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.846978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb9a9-b66c-400f-9080-f4221dd0a1e8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:01.888990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:01.890392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:01.891114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:01.891294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:01.891566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:01.895957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705eb39-90c7-4d29-9235-30592b65b4de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.897444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705eb39-90c7-4d29-9235-30592b65b4de None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.899445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:01.901685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:01.914597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:01.915533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:01.916409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 320/630] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:01.916948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:01.972485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.011929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 311/631] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:54:02.013467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896211c8-05b5-4e5e-b27e-bb8726a40a56 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.013751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896211c8-05b5-4e5e-b27e-bb8726a40a56 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.014018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896211c8-05b5-4e5e-b27e-bb8726a40a56 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.016916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 312/632] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:02.016916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896211c8-05b5-4e5e-b27e-bb8726a40a56 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.021827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1ebae-d22c-42d5-8729-c805cd955152 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.057401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.058036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.058313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.058581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.070223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.071883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:02.086615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:02.087558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:02.088444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:02.088444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:02.088444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:02.092446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 321/633] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:02.093315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.121075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.129848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896211c8-05b5-4e5e-b27e-bb8726a40a56 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.164460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.165091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.165368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.165641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.166345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:02.166646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.168071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2522f-735e-49b3-a50d-b72d592a218a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.179568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 313/634] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:02.180737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafe4fa-35ac-46f4-b1b6-b67def619317 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.181041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafe4fa-35ac-46f4-b1b6-b67def619317 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.181310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafe4fa-35ac-46f4-b1b6-b67def619317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.196533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7572a-ea17-4d19-9ff0-63216db6a20d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.198758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5fafe4fa-35ac-46f4-b1b6-b67def619317 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:02.200000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5fafe4fa-35ac-46f4-b1b6-b67def619317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:02.203445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.231430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.232057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.232350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.232600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.242348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.243773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:02.258165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:02.259132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:02.260016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:02.260016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:02.260016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:02.260016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 322/635] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:02.260016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.274071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 314/636] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:02.275402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18bff-f937-49fc-a7bd-80f1b0ef27b1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.275691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18bff-f937-49fc-a7bd-80f1b0ef27b1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.275965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18bff-f937-49fc-a7bd-80f1b0ef27b1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.277218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 315/637] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:02.277961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18bff-f937-49fc-a7bd-80f1b0ef27b1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.368889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.371937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5009c66-4121-4dce-991e-712a04613775 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.384705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18bff-f937-49fc-a7bd-80f1b0ef27b1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.405854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.406472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.406752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.407042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.407669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:02.407972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.409386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.420943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb40714-786b-4431-ab9e-d2d077c09f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.421606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40714-786b-4431-ab9e-d2d077c09f0e None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.421885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40714-786b-4431-ab9e-d2d077c09f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.422156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb40714-786b-4431-ab9e-d2d077c09f0e None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/844c5874363b4611b64c3ffa2dc1033c/roles/1879d0da387f4397abd072af56a60001` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.426351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 323/638] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:02.427293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.439366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40714-786b-4431-ab9e-d2d077c09f0e None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=844c5874363b4611b64c3ffa2dc1033c, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.440868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb40714-786b-4431-ab9e-d2d077c09f0e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.446162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.465003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 316/639] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:02 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/844c5874363b4611b64c3ffa2dc1033c/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:02.465003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599210d7-252d-4129-a68e-0391eee59dda None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.465003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599210d7-252d-4129-a68e-0391eee59dda None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.465003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599210d7-252d-4129-a68e-0391eee59dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.475751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-599210d7-252d-4129-a68e-0391eee59dda None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:02.477155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-599210d7-252d-4129-a68e-0391eee59dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:02.560573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 317/640] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:02.569019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599210d7-252d-4129-a68e-0391eee59dda None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.580351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc457-f218-4614-ac2b-f449456c949c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.635211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.635750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.636021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.636284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.637243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:02.637243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.638589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.638712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.653462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 324/641] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:02.654312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.687038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599210d7-252d-4129-a68e-0391eee59dda None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.740170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.742414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.742914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.743393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.750916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.755634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.757684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:02.774295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:02.775262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 03:54:02.776185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:02.776719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f1624-aa75-4735-883e-34c1f82ffa31 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.778172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 318/642] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:02.783678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.819774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.820406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.820679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.820991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.832326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:02.837994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:02.838997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:02.839834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:02.844109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 325/643] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:02.844998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.905695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa164f-7e3f-47cb-b223-ee41cd710a74 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.933851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:02.943382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.944017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.944290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.944641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.949672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ded5b9-10eb-4c8b-9bfc-104570f709fa None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:02.951194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.952640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:02.963901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:02.965011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 319/644] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:02.966096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:02.989755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:02.990427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:02.990686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:02.990956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:02.991938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:02.992044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:02.993413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.004678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.016938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 326/645] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:03.018074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.077456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bead1-e517-4fb2-bebd-ab3a332f9dc4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.114731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.115842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.116259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.116666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.117110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563edf3-f1e6-4a4b-9b0c-cd582befb1c4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.130051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:03.137034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:03.138157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:03.139190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:03.142088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 320/646] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:03.143163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.156181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.157131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.157421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.157694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.158695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:03.159157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.160558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.173544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 327/647] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:03.173544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.199611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.232822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.261529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931937b3-3715-4107-8b85-7ea6f5641a5d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.279964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604609-cd37-403d-9a73-01c5a7406e27 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.293948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.294561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.294840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.295118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.295812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:03.296119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.297594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.310115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 321/648] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:03.310929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.321854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.322648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.323128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.323406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.395922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.397499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.416346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4858-5d78-4175-9982-35308f4fd9b5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.424181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.453659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.454305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.454582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.454856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.455718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:03.455990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.457501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.458732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.472499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 322/649] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:03.472499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.506620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 328/650] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:54:03.507763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.581233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cfba2-b248-4ee7-94cf-720b539c30aa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.614406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf2edd-a1bc-4595-9b05-47c011ab20a8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.617927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.618569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.618848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.619120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.631026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.632481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:03.648438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:03.649477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:03.650376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:03.650376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:03.650376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:03.650376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 323/651] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:03.650376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.651522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.652121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.652392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.652654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.653402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=15d3488259a0490bb05a0c49688f5957) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:03.653705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.655117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.668417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 329/652] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/role_assignments?user.id=15d3488259a0490bb05a0c49688f5957&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:03.670198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.681592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.709882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.794553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103ed52-dbe1-4046-9ab5-8a2fc3b3ec4f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.807436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b4f3-10b1-4665-846d-4da7cc58e974 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.838480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.839554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.839841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.840115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.853816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.855442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.858992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:03.859635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:03.859910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:03.860180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:03.870733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:03.871733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:03.872642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:03.872642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:03.872642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:03.872642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 324/653] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:03.873416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.879610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:03.881151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:03.900694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:03.901787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:03.902680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:03.902680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:03.902680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:03.902680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 330/654] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:03.903524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:03.966678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:03.995658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944a029-d1c7-41bc-8ac5-8ae33f1300ee None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:03.997204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.028981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98ac5d-ba79-4467-89f5-c5f49e1e240f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.043621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.044660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.045043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.045438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.046421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:04.047058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.048469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.064108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.064821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.065198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.065453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 325/655] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:04.066307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.069942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.070774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:04.071157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.072659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.090350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 331/656] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:04.091398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.178544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f605-c439-42f1-8ccd-8be5db1e5fba None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.194438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d931312-eaae-411e-80c9-6bd6f6be52d9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.210290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.217427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.217971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.218245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.218509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.219254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:04.219554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.221056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.231101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.231795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.232073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.232344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.234313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.235508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 326/657] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:04.236450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.241117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.242823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:04.255833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:04.257895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 03:54:04.260175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:04.268832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 332/658] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:04.268832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.343743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58241da6-4f1d-4706-8281-c55d0a057370 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.368290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8798-6973-41f6-8dfc-8f286a01f490 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.379548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.380217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.380492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.380758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.388285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.389758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:04.400712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:04.401664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 327/659] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:04.402596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.406624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.407330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.407602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.407869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.415097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.416519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c3305d91-63d6-429b-9fc7-34221a0c7b3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:04.428018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:04.428952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 333/660] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:04.430650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22167-5fa7-4f44-9a9e-c9d1c12c2678 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.431221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22167-5fa7-4f44-9a9e-c9d1c12c2678 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.431221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22167-5fa7-4f44-9a9e-c9d1c12c2678 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.432406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 334/661] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:04.432964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b22167-5fa7-4f44-9a9e-c9d1c12c2678 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.464028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.499148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.513834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428d7f-36c9-40db-9e42-10831a3c0e46 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.547921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b22167-5fa7-4f44-9a9e-c9d1c12c2678 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.548078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.548697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.549002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.549270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.550166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:04.551190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.552693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.575037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 328/662] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:04.575037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.587909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.588530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.588827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.589122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.589856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:04.590161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.591768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4acc8-7289-43fd-902e-c1f288fa54b9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.614328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 335/663] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:04.614328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.614328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.614328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.630167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:04.631347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:04.677600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccfc14-fbcb-4762-a19a-756d1c44bfc4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.689849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.712828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 336/664] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:04.712828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.736588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.737630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.738080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.738477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.739236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:04.739806 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.742073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.755215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:04.763215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 329/665] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:04.763215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:04.818011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e4c40-c741-40d2-831c-0fba517d472a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.855632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.856273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.856549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.856831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.895646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236e4f-3f53-4326-9c90-301e78673cb3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:04.934685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:04.936165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:04.940109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:04.940997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:04.941500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:04.941980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:04.982168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.000455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.034316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.035705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.050488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 337/666] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:54:05.050488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.142874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 330/667] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:54:05.143727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.152493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801723b-52cd-4dfb-a790-73926ddeb515 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.188946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.189564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.189819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.190083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.190890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=e43f4bd3ff65424eb02b4261d3c3d700) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:05.191180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.192686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.198544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 338/668] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/role_assignments?user.id=e43f4bd3ff65424eb02b4261d3c3d700&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:05.199339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.209135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.226994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.262747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ec64-bc72-44a5-b0e6-57f71b6c465a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.306155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.307397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.307857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.308558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.324347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:05.331252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:05.332480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:05.333649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:05.334460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385fbb4-7093-4a06-8d53-e7be9a4e82a9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.337277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 331/669] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:05.338436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.372830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.373637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.373919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.374190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.390095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.391341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:05.406906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:05.407908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:05.408895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:05.408895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:05.408895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:05.408895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 339/670] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:05.408895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.471968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c9ef-e022-435a-b225-23e46aec87d2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.482394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.510369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.520106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.520827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.521103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.521371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.532072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.533665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.534028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d48c7-f5a2-4185-bfeb-0f638f32f282 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:05.548994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:05.549999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:05.550982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:05.550982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:05.550982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:05.550982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 332/671] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:05.551703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.573138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.573919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.574499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.574771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.575450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:05.575750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.577601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.589045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 340/672] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:05.590097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.667314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa58b-01be-4185-8b97-19a5d024489f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.715760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.716692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.717018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.717292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.717945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:05.718249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.718615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df253c-13f1-46bd-a2b2-ed14a473f855 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.719623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.733321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 333/673] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:05.734452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.747845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.764726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.765406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.765689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.765959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.766604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:05.766908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.768276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ec74-fdd9-41b8-bacf-edc60929e816 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.780593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:05.787209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 341/674] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:05.787209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6944490-25a0-4e0b-994e-c97867ad1251 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.787209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6944490-25a0-4e0b-994e-c97867ad1251 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.787209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6944490-25a0-4e0b-994e-c97867ad1251 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.789992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 342/675] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:05.790672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6944490-25a0-4e0b-994e-c97867ad1251 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.841378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7f63e-3c0b-4539-a6f2-6b84f560c9ad None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.877983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.879199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.879726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.880205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.891589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.893201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.894598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6944490-25a0-4e0b-994e-c97867ad1251 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:05.908691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:05.910017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:05.911148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:05.911148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:05.911148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:05.911148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 334/676] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:05.911148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:05.937383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:05.937963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.938242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.938522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.945143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:05.947031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-cf8cda9c-206f-4bdf-a1ac-e894f283d694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:05.958372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:05.959303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:05.960230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 343/677] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:05.960717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:05.960717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:05.961376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:05.979198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:05.980371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:06.013614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.017619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.021679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bc3c3-27a4-4ed7-9ce6-69649fd24b47 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.052913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 344/678] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:06.053756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.066901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.068054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.069036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.069328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.078321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.079780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:06.091207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:06.092126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:06.093085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:06.096964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 335/679] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:06.097799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.184833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adca0-8737-445b-9cb0-a883ad94a143 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.201251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074068-48da-4c34-bd9b-622e2ff855c9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.235369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.236411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.236923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.237372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.238251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:06.238357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.238933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.239368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.239581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.239692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.240463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:06.240859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.241610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.242429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.256089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 345/680] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:06.257157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.260435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 336/681] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:06.265638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.282032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.297482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.375742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99fae-c99d-4812-9e8e-1c0aed0d0a63 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.378584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c14337-f03f-4490-ae44-9c1d374a4d60 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.412794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.413534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.413889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.414166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.414327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.414941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.415219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.415488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.416183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:06.416485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.417942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.421656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.423241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.431058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 346/682] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:06.431948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:06.441179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:06.442300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:06.443257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:06.444874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 337/683] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:06.445878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.529170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.532917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.541402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df425440-b260-42bb-a8b7-5a6675d48ea4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.558529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1433-e9b7-4288-b8e3-6417b2acd4d0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.577155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.577766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.578041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.578305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.579030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=36e52c9271db4196a138de433b75b422) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:06.579335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.580760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.587390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 347/684] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/role_assignments?user.id=36e52c9271db4196a138de433b75b422&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:06.595086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.596043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.596518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.597000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.597948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.611315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:06.617868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:06.618875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:06.619732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:06.622587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 338/685] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:06.623737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.738921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b4ea-5ebf-4f17-acb0-65a6dad2a592 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.766748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09330040-484b-44c8-b630-bad02a1470ad None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.796448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.797272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.797555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.797833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.798900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=5557665d603448c3bdeed0b5701e8ce2) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:06.799216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.801124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.812216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 348/686] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/role_assignments?user.id=5557665d603448c3bdeed0b5701e8ce2&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:06.812405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:06.812523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.812605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:06.815005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:06.815005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:06.815005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:06.815005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:06.817781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:06.817931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.839864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:06.841033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 339/687] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:06.847969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:06.954228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a20462-5489-4692-8ea3-d9329df36fe3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:06.984561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b5bd5-1951-40b8-b5ce-7a89e0b1f1cc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.005318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.005949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.006317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.006588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.007259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:07.007631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.009209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.019645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 349/688] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:07.025291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.027210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.027836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.028111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.028380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.090178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.100835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.102385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.118738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.142255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719873f-26b6-4509-906d-836fd3aeedf3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.179624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.180630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.181155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.181752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.194038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.195778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.207171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 340/689] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:07.212025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:07.213060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:07.214044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:07.214044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:07.214044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:07.214225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.220996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 350/690] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:07.223759 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.311314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.320687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6bdb-f9d2-4ed3-a091-29a2c927b250 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.330832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b81c-22d5-416a-a49d-87be7bf4a245 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.362971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.363627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.363899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.364381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.364663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.369956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.370866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.371341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.372271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.373181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:07.374081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.375514 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.376251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ed7ee-9def-442e-8e8b-1ea8a0acc065 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.377002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.391581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 351/691] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:07.397497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f28f-8877-4cd5-9b13-448274d40f06 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:07.397624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:07.398538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:07.399454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:07.399454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:07.399454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:07.399454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 341/692] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:07.399694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f28f-8877-4cd5-9b13-448274d40f06 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.399694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f28f-8877-4cd5-9b13-448274d40f06 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.399694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 352/693] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:07.403718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.404878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f28f-8877-4cd5-9b13-448274d40f06 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.509535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbf736-61fd-4347-bb93-3642830bd7de None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.512273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f28f-8877-4cd5-9b13-448274d40f06 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.544972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.546024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.546549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.547028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.548010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.548750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.549147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.549597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.550336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:07.551009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.552355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69c95-31c7-4d59-8187-1c4244115f8c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.556178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.557809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.564904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 353/694] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:07.566299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.566668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.567029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:07.570356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:07.571410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:07.572400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:07.574118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 342/695] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:07.578764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.582722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.594731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:07.596372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:07.649213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.669511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 354/696] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:07.670409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.683987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902424e-f883-4b8c-919c-37ac4b33d6bc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.790235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.790805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.791036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.791300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.796350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc14c-c597-46b7-877a-5fbf481b52cf None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:07.811845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.813265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.833262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:07.834134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:07.835005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:07.835935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:07.837004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:07.837497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:07.837954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:07.838885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:07.839388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:07.841168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:07.841290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 343/697] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:07.846525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.861319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 355/698] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:07.867551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:07.961323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:07.982488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d2183-cc75-49d6-ae03-a4acf06dd755 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.017161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.057747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.058278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.058552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.058819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.078175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fb9b6-3130-4123-852c-acffea643336 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.119575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.120500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.120782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.121076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.122035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:08.122342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.123943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.131179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.133404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.138861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 344/699] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:08.139761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.178086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.246081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 356/700] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 03:54:08.246081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.270065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf07a3-a3c7-4dd0-96aa-6d45c33de712 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.296768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.309104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.309776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.310059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.310326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.325478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.326946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:08.343151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:08.344232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:08.345176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:08.345176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:08.345176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:08.345176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 345/701] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:08.345409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.379823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea108ae-8c2e-41c9-8604-02bbb42fa54f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.422931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.424007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.424473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.424969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.426306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=844c5874363b4611b64c3ffa2dc1033c) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:08.426875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.428908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.436990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 357/702] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:08 2022] GET /identity/v3/role_assignments?user.id=844c5874363b4611b64c3ffa2dc1033c&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:08.438129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.444074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.457801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b8161-645e-4322-9ee3-c9c52e7ed16b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.515459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.518276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.518792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.519560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.543885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.546368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:08.576182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:08.577215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:08.578112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:08.578112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:08.578112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:08.589108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 346/703] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:08.591777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.633755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c566-eb88-4e68-81f5-ed98d9bba0c3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.642684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.677875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.678537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.678818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.679087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.679735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:08.680050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.681661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.697552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 358/704] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:08.705239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.728567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a620b-a948-488a-a3e2-7cfe53fce55e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.770544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.771164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.771438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.771704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.772354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:08.772655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.774057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.792410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.793106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 347/705] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:08.799428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:08.839113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b36304-aaf6-4767-b59d-36ed72c3c6d1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.880084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7b508-ae66-4e90-925b-8c1cc7781f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.880702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7b508-ae66-4e90-925b-8c1cc7781f0e None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.881007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7b508-ae66-4e90-925b-8c1cc7781f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.881280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7b508-ae66-4e90-925b-8c1cc7781f0e None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.881937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7b508-ae66-4e90-925b-8c1cc7781f0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:08.883393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7b508-ae66-4e90-925b-8c1cc7781f0e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:08.904729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:08.922084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 359/706] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:54:08 2022] POST /identity/v3/users => generated 254 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:08.927955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9542ad8-3547-491c-bbbb-4b7823726625 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.927955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9542ad8-3547-491c-bbbb-4b7823726625 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.928242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be116230-676a-4581-881d-a55d8f8cb513 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:08.928322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9542ad8-3547-491c-bbbb-4b7823726625 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.929276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 360/707] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:08.935832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d26186-1e11-4c05-9daf-86db19249818 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:08.936170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d26186-1e11-4c05-9daf-86db19249818 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:08.936380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d26186-1e11-4c05-9daf-86db19249818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:08.971525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f6d26186-1e11-4c05-9daf-86db19249818 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:08.972988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f6d26186-1e11-4c05-9daf-86db19249818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:08.998549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:08.999253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.000461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.000461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.016370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:09.017898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:09.036756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:09.037757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:09.038628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:09.039266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 348/708] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:09.044019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:09.115391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 361/709] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:09.154181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f31fa-5f68-4f59-9437-8a32c56d9889 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.154807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f31fa-5f68-4f59-9437-8a32c56d9889 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.154807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f31fa-5f68-4f59-9437-8a32c56d9889 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.156166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 362/710] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:09.161803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.162487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.163056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.187969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:09.189907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:09.209947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824d8d0-220e-4e71-8ad3-37bfa1e26974 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:09.246556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:09.255568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:09.256193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.256519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.256790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.257549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:09.257814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:09.260025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:09.275865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 363/711] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:09.277464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 349/712] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:09.291094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:09.403131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca46f0-0037-4aff-b91b-b8f78f8ca6f1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:09.420370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:09.440824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:09.445736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:09.446432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.446774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.447253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.448179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7514901da21f40398a0143744fd11757, user.id=15d3488259a0490bb05a0c49688f5957) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:09.448552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:09.450449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:09.456795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 364/713] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/role_assignments?user.id=15d3488259a0490bb05a0c49688f5957&scope.project.id=7514901da21f40398a0143744fd11757&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:09.580502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:09.607767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44393fef-a8a4-46b9-ae0b-b62a995adbf6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:09.636190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:09.662767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:09.663396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.664278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.664554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.665308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:09.667087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:09.681725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:09.682835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:09.683680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 350/714] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:09.695011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:09.725340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5658ee-25d4-4f05-98af-b7606ce5648b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:09.800000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:09.800638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.800936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.801202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.801904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:09.803263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:09.822595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:09.823706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:09.824610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 365/715] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:09.829490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:09.850140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:09.894075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25339e84-a175-418c-b7c6-bc4b289b9862 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:09.961044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:09.961575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:09.961848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:09.962117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:09.962750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:09.963047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:09.964448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:09.972167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 351/716] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:09.977968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:10.002860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6eea-c3f4-4223-bb61-90e6852b83e1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:10.018235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:10.086185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:10.086704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:10.086981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:10.087246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:10.087919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:10.088165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:10.089563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:10.106749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 366/717] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:10.109398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84570c-876c-4ce1-8081-faa850c60ea7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:10.112611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:10.146085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:10.146943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:10.147359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:10.147932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:10.148704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:10.149205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:10.150773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd077-d6b5-4193-bd2d-5341372e8220 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:10.154416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:10.157779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 352/718] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:10.251128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ddc-4d13-4059-bb29-8cd0d545b917 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:10.288393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:10.289430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:10.289880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:10.290315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:10.291182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:10.291669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:10.293254 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac84dd-8eb4-4494-a80e-aa7ff65b903c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:10.300276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 367/719] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Aug 31 03:54:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:11.038911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3c78-d186-4e24-aa8f-34f860fabf84 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.039447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3c78-d186-4e24-aa8f-34f860fabf84 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.039447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3c78-d186-4e24-aa8f-34f860fabf84 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.041023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 353/720] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:11.046454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc1d58-0b85-45df-8789-1895fcb82434 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.046745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc1d58-0b85-45df-8789-1895fcb82434 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.047017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc1d58-0b85-45df-8789-1895fcb82434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.065996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a3cc1d58-0b85-45df-8789-1895fcb82434 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:11.067249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a3cc1d58-0b85-45df-8789-1895fcb82434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:11.097465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:11.153382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 368/721] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 03:54:11.332325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ffad-5afd-4e68-be57-d15f00bef79c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.332506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ffad-5afd-4e68-be57-d15f00bef79c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.332874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ffad-5afd-4e68-be57-d15f00bef79c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.334475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 354/722] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:11.339422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558b27-1124-4f9c-b345-fb94e6dd64dd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.339865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558b27-1124-4f9c-b345-fb94e6dd64dd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.340032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48558b27-1124-4f9c-b345-fb94e6dd64dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.360789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-48558b27-1124-4f9c-b345-fb94e6dd64dd None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:11.361989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-48558b27-1124-4f9c-b345-fb94e6dd64dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:11.442666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 369/723] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:11.586429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a4ef-5a15-4f5b-b9f6-59315a81f918 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.586735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a4ef-5a15-4f5b-b9f6-59315a81f918 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.586912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596a4ef-5a15-4f5b-b9f6-59315a81f918 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.588496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 355/724] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:11.593469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.593755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.594026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.608911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a4ef-5a15-4f5b-b9f6-59315a81f918 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:11.633508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:11.634704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:11.768670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 370/725] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:11.781760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596a4ef-5a15-4f5b-b9f6-59315a81f918 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:11.806208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:11.835624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:11.836269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:11.836650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:11.836890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:11.846673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:11.855285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:11.863001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:11.864034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:11.864992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:11.874142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 356/726] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:11.879229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:11.979453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:11.980717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f39d-a931-445c-9085-b1bbfecc2507 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.041960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608bffa-7269-4659-a0de-d53021f40579 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.047948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.048730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.049124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.049486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.060703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:12.065370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:12.066493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:12.067562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:12.069448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 371/727] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:12.070374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.088896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.089982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.090433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.091174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.092011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:12.092459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.094601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.107350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 357/728] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:12.113593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.161202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.178723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbed5d-d98d-48a0-986d-873ca55489aa None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.216508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.217347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.217717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.218081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.231038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:12.236244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799bb7-607f-4a7d-a419-66ed8160981f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:12.236473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:12.237453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:12.238291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 372/729] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:12.239096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.264667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.278754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.279455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.279800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.280140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.281001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:12.281656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.283105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.292237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 358/730] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:12.293265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.361074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31408cf4-277f-4d3d-84d0-b8987092d484 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.409282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.410986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.411439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.411875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.415999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9dbd-acd4-47c4-894a-06fc3779d88e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.426192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.428709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.438122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:12.450164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:12.451134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:12.452057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:12.452057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:12.452057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:12.458938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 373/731] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:12.458938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.459565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.460184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.460457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.460728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.461830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:12.462131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.463666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.473489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 359/732] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:12.474600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.526375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.585324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192de2-54c4-4ab9-9f76-ab4174e4cd69 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.594598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6fe6e-3044-489d-9c63-f135463c9a93 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.622780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.623425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.623712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.624012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.624752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:12.625103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.626582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.635085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.635717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.635992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.636263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.642186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 360/733] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:12.643185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.647914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.649505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-581391d5-8ac1-468a-b4b2-736b484b57cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:12.663952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:12.665117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:12.666443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:12.666443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:12.666443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:12.666443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 374/734] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:12.666678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48c09f-cc1a-4709-9ca8-938f615ff4c7 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.666862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48c09f-cc1a-4709-9ca8-938f615ff4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.667060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48c09f-cc1a-4709-9ca8-938f615ff4c7 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.668403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 375/735] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:12.669490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48c09f-cc1a-4709-9ca8-938f615ff4c7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.728454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.753665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2077a6-00b8-4cd1-ab22-cf5fcb12c533 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.760753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.780865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48c09f-cc1a-4709-9ca8-938f615ff4c7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.788077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.788787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.789102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.789368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.800028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.801582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.816020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a17371c3-fed9-4bb9-a596-86d9f6cee98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:12.816435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:12.817484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:12.818373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:12.818373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:12.818373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:12.818547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.818547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.818547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.818745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 361/736] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:12.818745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed786e-8bb7-4ec9-a9fe-ea935432fd46 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.819026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed786e-8bb7-4ec9-a9fe-ea935432fd46 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.819279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed786e-8bb7-4ec9-a9fe-ea935432fd46 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.820428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 362/737] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:12.821133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed786e-8bb7-4ec9-a9fe-ea935432fd46 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.831140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.833030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f2ff966d-d8c9-416e-a0f4-64c6f7d1062f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:12.844515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:12.845504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:12.846572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 376/738] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:12.847763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.847763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.847763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.864786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:12.865999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:12.927898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed786e-8bb7-4ec9-a9fe-ea935432fd46 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:12.931582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 377/739] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:12.932406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:12.972027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:12.973057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.973537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:12.974342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:12.974798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:12.975775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:12.976267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:12.977857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de16461-fcf3-4d45-ad52-401ec0b0eaf5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:12.997510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 363/740] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:12.999192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:12.999681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.000183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.023047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:13.024817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:13.040284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f593c-0d2d-45f5-9d36-ef26643e8b4b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.045274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.077931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.078772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.079080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.079444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.080178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:13.080569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.082226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.097940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 378/741] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:13.097940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.105072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 364/742] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 03:54:13.117726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.198648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.201528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974278fa-4b5b-434f-90b0-5b111d86b592 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.236314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.236942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.237219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.237483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.238033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d14c-1fb9-4c8c-8861-2a4f859943ef None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.238253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:13.238554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.240000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.261299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 379/743] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:13.261299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.277909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.278543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.278814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.279082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.286158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.287647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:13.298800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:13.299764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:13.300748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:13.304758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 365/744] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:13.305448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.316292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.369278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ca64d-3b32-4637-b347-8100f477188e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.406408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.407034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.407304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.407567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.409487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54620a10-9566-48c4-82a1-2bf6603133b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.414501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.415942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:13.429946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:13.431167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 380/745] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:13.432174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.447095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.447718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.447979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.448256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.448990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.450149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.450306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.467838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 366/746] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:13 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:13.468745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.540671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.544899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39231ef9-51da-45f5-9f92-c832899e1663 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.586739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bcb85-6deb-4d74-856a-e28bd76a96e9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.597398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.598104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.598426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.598693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.625035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.625749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.626657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.626657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.627016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:13.627627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.629131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.650043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 367/747] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:13.650870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.680694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.682771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.699468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.765107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da99e-6ba5-460c-aa78-fcc4243567e7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.788452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.797174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 381/748] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 03:54:13.801732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.805479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.806331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.806607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.806872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.807531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.808964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.824711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 368/749] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:13 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:13.825502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:13.922355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2980-e718-4aa6-b574-8cfb73704cb2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.938335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:13.963651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58a4c6-80aa-497f-8913-4326fda20283 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:13.967456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:13.968956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:13.969338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:13.969703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:13.970545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:13.970947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:13.972653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:13.993721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 382/750] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:13.996870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.012421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.013741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.013741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.014033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.074869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.102795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.104787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.143667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beec211-578f-417f-b1a0-b2c7c61543fc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.191910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.192975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.193265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.193541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.206279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.208394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.221876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 369/751] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:14.223071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:14.226229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:14.227177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:14.228110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:14.228110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:14.228110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:14.228110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 383/752] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:14.228874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.261262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.312293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.339988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d4264-eef4-46e3-bd17-85fdc2f9477a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.359334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2a64-0d5e-49b4-b3c9-24cbb180b13b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.374821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.375452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.375727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.375990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.387233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.388786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.401526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.402171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.402450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.402720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:14.406651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:14.407572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:14.408454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:14.408454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:14.408454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:14.412551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 370/753] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:14.413506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.413689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.415351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:14.434625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:14.436733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:14.438095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:14.438095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:14.438095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:14.438095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 384/754] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:14.438095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.521942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52e5d-a1be-4765-aab2-59734211f6b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.536471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.559428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.563513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa81698-418a-41ff-8036-ce6598df98fe None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.566662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.567572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.568017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.568435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.569250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:14.569696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.571223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.585812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 371/755] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:14.586872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.599332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.600227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.600597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.601008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.601812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:14.602169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.603783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.622116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 385/756] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:14.623259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.697587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19093-5fcd-4679-b95f-f964913d09c1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.731164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbd508-5dd1-4b41-8714-8b4f3a204263 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.734419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.735043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.735321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.735591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.736241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:14.736544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.737969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.750919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 372/757] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:14.751817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.768648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.769688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.770207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.770666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.773747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.778612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.780527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:14.792551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:14.793458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:14.794346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:14.796743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 386/758] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:14.797814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.807469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:14.872827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6a1f3-941b-4361-a1e0-04f0b6ab558d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.899049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.899694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.900062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.900339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.906660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a24126-3f8e-4855-b2c8-b06883391824 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:14.907620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.909414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:14.921629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:14.922537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:14.923417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 373/759] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:14.923918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:14.942347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:14.942980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:14.943394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:14.943675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:14.951057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:14.952554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:14.965909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:14.968027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 387/760] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:14.970126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:15.029403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:15.035011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e7f4-f841-4893-9e19-ce4bca0fb037 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:15.046428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:15.072490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:15.073089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.073369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.073641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.074439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:15.074751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:15.076273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:15.079009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348ae8-a119-407e-aa32-7009746d28f2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:15.093923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 374/761] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:15.093923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:15.120568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:15.121549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.122005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.122447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.123360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:15.123925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:15.125525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:15.139098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 388/762] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:15.140389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:15.196778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cf6d6-34f5-4fbc-9bdb-3d03d5167ecb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:15.234477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:15.235349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.235527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.235778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.236613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:15.236864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:15.238402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:15.245173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874f353-72fd-4834-9e80-372ad81d0a07 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:15.250999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 375/763] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:15.251826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:15.264064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:15.283567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:15.284582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.285184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.285700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.286853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:15.287183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7514901da21f40398a0143744fd11757, user.id=844c5874363b4611b64c3ffa2dc1033c) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:15.288334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:15.290024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:15.305215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 389/764] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:15 2022] GET /identity/v3/role_assignments?user.id=844c5874363b4611b64c3ffa2dc1033c&scope.project.id=7514901da21f40398a0143744fd11757&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:15.306643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:15.364020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872cec-05fc-4eb9-a617-bc8a57a6af29 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:15.414864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e9069-c33d-4810-96c9-6397ec122ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:15.415557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e9069-c33d-4810-96c9-6397ec122ef0 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.415839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e9069-c33d-4810-96c9-6397ec122ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.416117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e9069-c33d-4810-96c9-6397ec122ef0 None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/15d3488259a0490bb05a0c49688f5957/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.422763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e9069-c33d-4810-96c9-6397ec122ef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=15d3488259a0490bb05a0c49688f5957, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:15.424275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e9069-c33d-4810-96c9-6397ec122ef0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:15.449020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 376/765] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:15 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/15d3488259a0490bb05a0c49688f5957/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:15.490252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504e532-54ef-4a7a-927c-6b7ec055367d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:15.537594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:15.538564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.539035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.539509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.540435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=d23ba460295c4b9a85db43e43081a595) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:15.541020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:15.542709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cb443-d928-40c8-aa4c-b442adf1f576 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:15.549938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 390/766] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:15 2022] GET /identity/v3/role_assignments?user.id=d23ba460295c4b9a85db43e43081a595&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:15.560469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d9bf-968c-4ff4-908e-e7ea91240d42 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.560844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d9bf-968c-4ff4-908e-e7ea91240d42 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.561065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d9bf-968c-4ff4-908e-e7ea91240d42 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.562853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 377/767] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:15.568774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37998-a396-4c18-b7ce-2dc5d0c44b71 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.569132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37998-a396-4c18-b7ce-2dc5d0c44b71 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.569346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37998-a396-4c18-b7ce-2dc5d0c44b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.592494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b2e37998-a396-4c18-b7ce-2dc5d0c44b71 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:15.594093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b2e37998-a396-4c18-b7ce-2dc5d0c44b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:15.656015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:15.709034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 391/768] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:15.902176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbacfd-f07b-4e43-b748-7d3e127794e4 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.902357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbacfd-f07b-4e43-b748-7d3e127794e4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.902636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbacfd-f07b-4e43-b748-7d3e127794e4 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.904220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 378/769] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:15.909676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:15.909958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:15.910230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:15.930785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:15.931965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:16.005848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 392/770] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:16.014988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbacfd-f07b-4e43-b748-7d3e127794e4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.108727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:16.119088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbacfd-f07b-4e43-b748-7d3e127794e4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.155573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.156239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.156512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.156848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.157490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.159105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:16.168369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:16.169417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:16.170288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 379/771] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:16.181032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.270563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.324530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fbcd-d9d9-42ec-9684-13766438705e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.331863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:16.394427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.395118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.395401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.395674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.396312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] RBAC: Adding query filter params (name=network) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:16.396615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.398017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.407051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ad959-500a-4340-ac0a-a0b7f06a51fd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.411110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 393/772] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:16.416404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.469947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.470588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.470859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.471129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.471712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.473126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:16.491751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:16.492815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:16.493670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:16.494417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 380/773] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:16.500769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.528836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:16.618498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fc31-014e-4267-afad-ffe6c854aa75 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.672226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6c694-6145-4849-be27-97e7610cbbc6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.696790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.697497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.697777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.698051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.698795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] RBAC: Adding query filter params (type=network) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:16.700925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.701040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.711120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.711831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.712177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.712521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.713543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:16.713919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.715359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.716739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 394/774] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:16.720539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 381/775] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:16.722486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.725887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.788381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:16.867273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb23a6-563b-49a5-bbe2-596a75a8d632 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.869132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:16.907891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.908528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.908835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.909118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.910007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] RBAC: Adding query filter params (interface=public, service_id=e473f6d56870400b9a7640fff6e0cf2b, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:16.910321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.911791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.912381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed5ac8-7642-4256-9ccd-3974340ddc20 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:16.922104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 395/776] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/endpoints?service_id=e473f6d56870400b9a7640fff6e0cf2b&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:16.928278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:16.978175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:16.979894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:16.980192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:16.980451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:16.981119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:16.981422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:16.983131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:16.990429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 382/777] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:16.996045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:17.115036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c23d-c29a-44ac-ba31-19c58a54d3ab None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:17.150099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:17.153145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:17.153772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.154212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.154493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.155204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] RBAC: Adding query filter params (interface=public, service_id=aaa2a63b407a4b27a2cbcb1ccca8843e, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:17.155837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:17.157533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:17.162943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae75b66-4160-433b-8546-71a23b71fc10 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:17.165955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 383/778] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/endpoints?service_id=aaa2a63b407a4b27a2cbcb1ccca8843e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:17.171867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:17.186660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:17.259413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1b4ca-86c4-4c3c-ab20-8b52a44b3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:17.260043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b4ca-86c4-4c3c-ab20-8b52a44b3611 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.260323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b4ca-86c4-4c3c-ab20-8b52a44b3611 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.260598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1b4ca-86c4-4c3c-ab20-8b52a44b3611 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.261246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b4ca-86c4-4c3c-ab20-8b52a44b3611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:17.262621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1b4ca-86c4-4c3c-ab20-8b52a44b3611 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:17.279453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 396/779] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:16 2022] GET /identity/v3/services => generated 772 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:17.284542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59edda1-8e4b-469d-b8d0-3f97cfc187d7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:17.322194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45140983-d2db-4818-ba5d-e31502da26dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:17.322815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45140983-d2db-4818-ba5d-e31502da26dd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.323093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45140983-d2db-4818-ba5d-e31502da26dd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.323362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45140983-d2db-4818-ba5d-e31502da26dd None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.323975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45140983-d2db-4818-ba5d-e31502da26dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:17.325429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45140983-d2db-4818-ba5d-e31502da26dd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:17.331547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 384/780] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:17 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:17.714548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e25e-db0f-4e8b-a7ad-f5c2a43a2c43 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.715073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e25e-db0f-4e8b-a7ad-f5c2a43a2c43 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.715073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e25e-db0f-4e8b-a7ad-f5c2a43a2c43 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.716698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 397/781] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:17.721854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b394b-b954-4921-9e3c-96d6099cadf4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.722146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b394b-b954-4921-9e3c-96d6099cadf4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.722421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b394b-b954-4921-9e3c-96d6099cadf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.749837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-656b394b-b954-4921-9e3c-96d6099cadf4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:17.751040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-656b394b-b954-4921-9e3c-96d6099cadf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:17.755688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e73-831b-4515-bb14-b541f676debd None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.755971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e73-831b-4515-bb14-b541f676debd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.756240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e73-831b-4515-bb14-b541f676debd None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.757821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 398/782] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:17.763117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76e27-95dc-436c-9946-fe625d304745 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.763405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76e27-95dc-436c-9946-fe625d304745 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.763685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76e27-95dc-436c-9946-fe625d304745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.801053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-95a76e27-95dc-436c-9946-fe625d304745 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:17.802331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-95a76e27-95dc-436c-9946-fe625d304745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:17.859500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 385/783] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:17.923100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 399/784] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:17.987103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b2769-b998-4dd6-b2ff-0709fb3f4336 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.987469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b2769-b998-4dd6-b2ff-0709fb3f4336 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.987838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b2769-b998-4dd6-b2ff-0709fb3f4336 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:17.989636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 386/785] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:17.995077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002352ab-c718-460b-b743-000bfbe577dc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:17.995604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002352ab-c718-460b-b743-000bfbe577dc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:17.996103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002352ab-c718-460b-b743-000bfbe577dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:18.021797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-002352ab-c718-460b-b743-000bfbe577dc None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:18.023316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-002352ab-c718-460b-b743-000bfbe577dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:18.109388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 400/786] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:18.124593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b2769-b998-4dd6-b2ff-0709fb3f4336 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.128749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:18.267464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b2769-b998-4dd6-b2ff-0709fb3f4336 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.301815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:18.302749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:18.303265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:18.303766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:18.316173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002352ab-c718-460b-b743-000bfbe577dc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.319964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:18.325132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:18.326116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:18.326964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:18.329283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 387/787] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:18.339262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.343690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:18.431425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002352ab-c718-460b-b743-000bfbe577dc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.449240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:18.496956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e967d0-4d15-4fc9-98a9-104025c76bb4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.534348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:18.534993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:18.535274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:18.535608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:18.536296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:18.536599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:18.538225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:18.551865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 388/788] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:18.551865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.597528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:18.598631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:18.599006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:18.599893 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:18.614377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:18.620983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:18.622112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:18.623172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:18.631437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 401/789] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:18.631437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.664095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f6a7b-f68c-448b-ba33-4b7f1a7d8be5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.696917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:18.713469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:18.714480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:18.714963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:18.715457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:18.728706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:18.729234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:18.735979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:18.737766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:18.738970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:18.741319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 389/790] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:18.742453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.759817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44793-38f6-43d6-b5ae-46c701e8568d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.797602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:18.798366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:18.798711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:18.799068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:18.812316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:18.814511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:18.831622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:18.832747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:18.833738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:18.833738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:18.833738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:18.837313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 402/791] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:18.838316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:18.949867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb861e-de09-4153-8e8d-c739ca2c65e8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.976462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ce85-55bb-4583-8658-83a6313f3f0e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:18.987566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:18.997828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:18.999515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:18.999936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.000283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.001187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:19.001578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.004049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.020072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 403/792] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:19.020072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.023639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.024464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.024974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.025431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.026284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:19.026854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.028414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.042629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 390/793] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:19.043854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.095917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.140714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204bfb-b4bf-4f76-9872-e931d918ff65 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.153490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fb6a8-c777-4bb9-a3d3-d435c0f0cf4d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.185218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.186061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.186346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.186620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.187575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:19.187890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.189748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.192595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.193497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.194035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.194516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.204942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 404/794] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:19.206099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.209997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.211718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:19.235532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:19.236561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:19.237517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:19.237517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:19.237517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:19.240950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 391/795] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:19.242871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.276776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.332117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71a4c5-0bba-4e98-8611-7c2270108cbb None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.366823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.367372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.367649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.367918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.379245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.380719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.383012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.386864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f3c0-bb77-4e47-baa9-84e4fc743ad6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:19.397742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:19.398725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:19.399629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:19.399629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:19.399629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:19.399629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 405/796] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:19.404383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.433932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.434790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.434903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.435159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.443188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.444686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:19.456451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:19.458076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:19.459029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:19.462422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 392/797] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:19.463303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.538248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5559a-86b1-4aad-9e6f-028aae61d712 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.547817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.566326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3404a-b33f-456a-9fd3-4a669cabeb2c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.578905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.579512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.579795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.580058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.580693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:19.581033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.582541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.593593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 406/798] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:19.594374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.600552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.601196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.601477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.601746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.602391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:19.602691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.604063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d606644-a7bc-4fa5-a2f7-eb42b254a55a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.615711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 393/799] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:19.616957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a17c15-6f45-4156-9fde-17e6d3f2b53d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.617187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a17c15-6f45-4156-9fde-17e6d3f2b53d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.617461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a17c15-6f45-4156-9fde-17e6d3f2b53d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.620945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 394/800] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:19.620945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c996c-c250-4c92-91ab-1a8c002e69a6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.620945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c996c-c250-4c92-91ab-1a8c002e69a6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.620945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c996c-c250-4c92-91ab-1a8c002e69a6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.621857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 395/801] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:19.622549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c996c-c250-4c92-91ab-1a8c002e69a6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.643658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.700745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011ee82-520c-47d1-9692-794ccfaf2ad6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.729406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c996c-c250-4c92-91ab-1a8c002e69a6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.734756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.735364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.735645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.735909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.736639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:19.736969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.738403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.760059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 407/802] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:19.760059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.765078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.765718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.765981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.766240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.773265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.774689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.783501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e16cd08b-4539-4940-ab6e-380c35ee125f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:19.785942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:19.787050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:19.788006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 396/803] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:19.788593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4397546-edd2-4472-aa80-f1437520a3c9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.788593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4397546-edd2-4472-aa80-f1437520a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.788725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4397546-edd2-4472-aa80-f1437520a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.805480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b4397546-edd2-4472-aa80-f1437520a3c9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:19.806659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b4397546-edd2-4472-aa80-f1437520a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:19.860606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20e08-8ac5-4e03-b83e-c1545e3d4940 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:19.875584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 397/804] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:19.876748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.877060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.877641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.895326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:19.896562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:19.899532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:19.899762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:19.900404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:19.900678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:19.900978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:19.909321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:19.910837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:19.922744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:19.923879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 408/805] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:19.925248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:19.976852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 398/806] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:19.976852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.022269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.039070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d157a0-2ec3-491b-8ab7-b38746a5b088 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.082579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.083924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.084621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.085052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.097329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.098865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.099601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92079-4d84-43ed-bed3-77ebdf7c7658 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:20.113582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:20.114828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:20.115919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:20.115919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:20.115919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.116867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 409/807] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:20.117810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.144914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.145529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.145800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.146063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.146789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:20.147089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.148508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.158074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.171413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 399/808] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Aug 31 03:54:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:20.171413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.230625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24b07f-9a1b-42f5-b3c9-c4ac0e61ce3a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.269174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.269783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.270117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.270389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.271119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:20.271451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.271571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb434ec-eee8-4caa-9d0c-eea8d1011254 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.272894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.275437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.290274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 410/809] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:20.291080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.305775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.306515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.306847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.307123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.307772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:20.308100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.309518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.320952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 400/810] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:20.322242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.379625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.398704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fec96-ef0d-4fe3-ada6-19ec27ff6c6c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.420657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95365f-b521-4ca6-a8e1-431fbc0999c5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.431925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.432579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.432848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.433117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.433692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.435040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:20.443693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:20.444960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.450573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 411/811] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:20.451467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.453878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.454516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.454793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.455063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.465904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.467333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:20.481051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:20.482193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:20.483157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:20.483157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:20.483157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:20.483157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 401/812] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:20.483157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.509672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.552132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc243b-f472-4bed-b067-5950d842c2d2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.581114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d864-2144-4a4e-a88e-8a5d35fae558 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.587263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.588334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.588756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.589268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.589899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.591372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.591872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:20.601514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:20.602642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.603501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 412/813] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:20.604311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.620163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.620782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.621113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.621384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.686652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.688043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.701707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b286db-74e4-4c9b-8f7a-2dc823b211b7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.724542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.737008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.737637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.737912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.738521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.744921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.746389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:20.757669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:20.758738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:20.759647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 413/814] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:20.760127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.785774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 402/815] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:20.786627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.799059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:20.861334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea0ea-2b25-4fab-b5f3-2c97b6113b2b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.886099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed038-394a-4550-83ac-8d137cb98e47 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:20.894634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.895286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.895560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.895822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.896471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:20.896765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.898142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.902548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 414/816] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:20.903522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.922535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:20.923148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:20.923425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:20.923694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:20.924339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:20.924640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:20.926038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:20.937371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 403/817] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:20.938175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:20.951988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.006808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef82b-f5a8-4b1b-9f63-de650030c524 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.007681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.038716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f4b6a-732a-436b-aa43-7b3d527d1226 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.040017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.040622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.040931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.041207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.041824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:21.042120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.043469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.047761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 415/818] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:21.048522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.080244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.080901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.081166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.081421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.082112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:21.082409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.084141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.096713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 404/819] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:21.097538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.154215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fd070-7a9e-460c-9ecd-ed4d7536a2a4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.164291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.187743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.188302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.188578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.188871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.198987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.200408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.200669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d417-99c5-495c-84c8-37f0505adb81 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:21.214169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:21.215161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:21.216048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:21.216048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:21.216048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:21.216048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 416/820] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:21.216048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.232718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.239300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.239910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.240189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.240460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.241119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:21.241422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.242788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.247684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 405/821] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:21.248519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.317584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12c84e-3863-4082-8699-e134d88965d6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.346995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e74046-e290-4e18-b910-ccc48b7df10a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.350241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.350868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.351144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.351398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.357951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.359391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:21.370602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:21.371736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 417/822] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:21.372840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.383822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.384438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.384713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.385007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.385633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:21.385934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.387282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.391820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 406/823] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:21.392578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.399410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.455398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.472744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b59a-0f3f-4c1d-a4cd-02afacba114b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.495880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6a47-2dc9-4919-9a5f-373e73e73a75 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.505997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.506655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.506929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.507192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/844c5874363b4611b64c3ffa2dc1033c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.509129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=844c5874363b4611b64c3ffa2dc1033c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.510570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.524339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 418/824] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:21 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/844c5874363b4611b64c3ffa2dc1033c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:21.525134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.544396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.545348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.546078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.546357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.547028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:21.547332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.549433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.568256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 407/825] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:21.568256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.624084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.647286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18839aff-6449-4215-ad12-c2be40fc8d26 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.680219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92334ee-e2c0-4db8-b701-a4a0f66ac391 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.688283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.688926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.689201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.689465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.690136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.691556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.707381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.717231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 419/826] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:21.718252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.738489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.739551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.740011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.740460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.741462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:21.741964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.743707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.763768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 408/827] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:21.765079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.858608 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d815f-70a9-4b6f-b4ae-7c3c0a06bf12 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.893791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eccc08-63c0-42da-8777-999e1a7e1e91 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:21.904604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.905325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.905601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.905870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.906622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.907895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.920631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:21.932905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:21.933517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:21.933864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:21.934119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:21.938693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 420/828] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:21.939142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:21.944139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:21.946102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:21.963191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:21.964120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:21.965073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:21.968333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 409/829] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:21.975309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:22.058510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:22.132951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968a660-638f-408a-b5ff-4ac81c5722fd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:22.147441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fab579-cb04-4d0c-a371-cfaf3ebdeb8e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:22.170730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f8e44-6c1c-4761-9d0c-840574980d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:22.171504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f8e44-6c1c-4761-9d0c-840574980d18 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:22.171780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f8e44-6c1c-4761-9d0c-840574980d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:22.172049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f8e44-6c1c-4761-9d0c-840574980d18 None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/d23ba460295c4b9a85db43e43081a595/roles/1879d0da387f4397abd072af56a60001` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:22.182931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:22.183683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:22.184048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:22.184411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:22.185285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:22.185683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:22.187210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:22.188331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f8e44-6c1c-4761-9d0c-840574980d18 None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=d23ba460295c4b9a85db43e43081a595, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:22.189965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f8e44-6c1c-4761-9d0c-840574980d18 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:22.203063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 410/830] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:22.210065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 421/831] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:21 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/d23ba460295c4b9a85db43e43081a595/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:22.212201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:22.318026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:22.325780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e54ea-8fd2-4099-947e-334b50a33d64 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:22.363203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:22.364062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:22.364430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:22.364845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:22.365747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7514901da21f40398a0143744fd11757, user.id=15d3488259a0490bb05a0c49688f5957) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:22.366145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:22.368124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8608d65-3eda-4b8c-a2d9-ebb26e3f5472 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:22.374794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 411/832] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:22 2022] GET /identity/v3/role_assignments?user.id=15d3488259a0490bb05a0c49688f5957&scope.project.id=7514901da21f40398a0143744fd11757&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:23.512551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82ec6-784a-47b1-ac7b-0692772ee6e4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:23.513123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82ec6-784a-47b1-ac7b-0692772ee6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:23.513123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82ec6-784a-47b1-ac7b-0692772ee6e4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:23.514700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 422/833] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:23.520080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ab0e-c20b-4724-8442-7ed433d0300c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:23.520455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ab0e-c20b-4724-8442-7ed433d0300c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:23.520660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ab0e-c20b-4724-8442-7ed433d0300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:23.538700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b992ab0e-c20b-4724-8442-7ed433d0300c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:23.539877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b992ab0e-c20b-4724-8442-7ed433d0300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:23.612914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 412/834] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:23.740602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce15ac-a939-4923-8902-013385640d90 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:23.740979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce15ac-a939-4923-8902-013385640d90 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:23.741161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce15ac-a939-4923-8902-013385640d90 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:23.742611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 423/835] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:23.747988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:23.748273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:23.748545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:23.771199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:23.772304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:23.838494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 413/836] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:23.883651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce15ac-a939-4923-8902-013385640d90 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:23.931638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:23.991445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce15ac-a939-4923-8902-013385640d90 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.026556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.027174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.027452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.027718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.038006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:24.042794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:24.043736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:24.044593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 424/837] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:24.050204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.068952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.106704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.158750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f51783-a09b-4462-9cd7-c98ba828ad37 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.193091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.193706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.193981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.194253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.194926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:24.195227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.196604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a3108-4da2-48bc-af9e-9fbb4285e5b9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.205252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 414/838] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:24.206584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818219-d909-4873-80f4-7c384cbc95d7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.206869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818219-d909-4873-80f4-7c384cbc95d7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.207139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0818219-d909-4873-80f4-7c384cbc95d7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.208719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 415/839] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:24.210952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0818219-d909-4873-80f4-7c384cbc95d7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.219545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.223474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057315-edf4-49a1-988c-a13bd6d316d8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.260509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.261418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.261833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.262235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.262973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.264333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e03743cf-f256-481e-bdaf-5fc1a4f3845b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:24.273251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:24.274301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:24.275144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 425/840] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:24.277058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.277058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.277058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.294750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:24.295925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:24.311683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.334774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0818219-d909-4873-80f4-7c384cbc95d7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.365848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 426/841] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:24.366760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.369114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.369741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.370011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.370273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.381321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.382836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d79b9e9a-8e0a-42e6-85e8-f9edb838c295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:24.396921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:24.397892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:24.398795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:24.398795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:24.398795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:24.398795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 416/842] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:24.399530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c23e71-2cea-4857-a773-1700f24a7b7d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.399743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c23e71-2cea-4857-a773-1700f24a7b7d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.400006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c23e71-2cea-4857-a773-1700f24a7b7d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.401368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 417/843] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:24.406027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c23e71-2cea-4857-a773-1700f24a7b7d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.476230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.485451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bc1fe-df9f-4cdf-8891-f87358e2d24b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.513586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c23e71-2cea-4857-a773-1700f24a7b7d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.524207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.524995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.525274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.525541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.526169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:24.526468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.527878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f10ad-d78f-410b-8c93-ac40e17bd0cf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.536656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 427/844] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:24.536656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.536656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.536656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.546703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.551847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.552544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.552840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.553112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.553234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:24.553745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:24.554037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.554371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:24.555394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.572779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 418/845] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:24.572779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.623697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 428/846] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:24.624619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.679364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2128b1d-a694-43a5-92c3-b2d37a5ffaaf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.712997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.724941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.725817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.726242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.726653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.727260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ea79-24dd-4ba5-9a28-7b28ac29076d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.727571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:24.728023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.729813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.734304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 419/847] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:24.735178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.776951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.777982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.778207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.778481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.788596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.790106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:24.806730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:24.807794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 03:54:24.808743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:24.813133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 429/848] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:24.814126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.816340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:24.870515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d97ec-2dda-41a6-9124-8ec046e03aa7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.909498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.910140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.910454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.910728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.922131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:24.927091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:24.928012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 420/849] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:24.929189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:24.946731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabf788-a70d-4e41-a884-7c0902b91919 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:24.984750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:24.985382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:24.985658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:24.985919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:24.986645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:24.986943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:24.988356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.006821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 430/850] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:25.007720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.019214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.042885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece091-b892-415e-b510-4361730aee41 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.060907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.080171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.080834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.081110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.081376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.081955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.083347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:25.092255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:25.093261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:25.094272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:25.098270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 421/851] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Aug 31 03:54:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:25.099117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.120901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74222e-4cab-4f80-b881-e1764c9739be None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.156849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.157797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.158233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.158645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.159439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:25.159879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.161477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.172863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 431/852] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:25.172863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.207693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f64e6-899d-4ff1-b727-ad38888105f8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.242698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.243316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.243914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.243914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.244579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.281078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb3c2-d384-496d-a981-f54051eaaa71 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.295281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.316156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.317732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.317931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.318503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.318781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.319043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.319820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:25.320116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.322223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.328845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 432/853] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:25.328845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.423103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 422/854] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:25.423785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.436820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205181a-cfb9-462e-9029-9b9a0a11f44f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.467795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.474238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.475015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.475293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.475554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.488785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.490499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.506799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:25.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:25.510224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:25.511121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:25.511121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:25.511121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:25.511121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 433/855] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:25.511121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.534430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8efcaf-c398-403a-b838-481371d3c684 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.571449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.572068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.572363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.572558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.573295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:25.573512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.574875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.579469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 423/856] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:25.580243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.647365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10e62f-1708-4521-a1f0-c1e4cf2e1267 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.697282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.698512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.702185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.702185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.707726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987095b-59ac-4d42-a3f6-a72430ad4ca6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.713463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.714935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:25.732650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:25.733663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:25.734560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:25.734560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:25.734560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:25.734560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 434/857] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:25.740224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.756188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.756897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.757167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.757433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.758075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:25.758370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.759740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.773711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 424/858] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:25.779159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.783234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.797149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:25.851149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078bc9-71a8-4712-bd27-8f050f64ce16 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.885901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.886505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.886779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.887041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.887677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:25.887976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.889379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.901508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d7f6-934a-4e42-ba5f-3bb6ea361501 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:25.906144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 435/859] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:25.907028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:25.953407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:25.954043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:25.954484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:25.954758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:25.964820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:25.966279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:25.980919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:25.981921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:25.983198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:25.983807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 425/860] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:25.989069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:26.037504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.044995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cb6d-3332-47d0-8e20-b7799205185a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.078406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.086341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.087588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.088117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.089196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.102287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.104480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:26.120500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:26.121639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:26.122774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:26.123308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c16d6-3521-459f-8639-1c1b1a212388 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.130814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 436/861] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:26.131245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:26.163853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.164519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.164812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.165086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.165821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:26.166199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.167548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.190722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 426/862] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Aug 31 03:54:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:26.192055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:26.257316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb89fb9-a913-4daa-8072-a460609a4038 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.292438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.293316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.293541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.293828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.294524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:26.294829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.296660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.314403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 437/863] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:26.315498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506a23f-5847-4d8e-b5b2-87add4f50e30 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.315756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:26.334440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.348231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.365274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558a193-6c19-4268-a081-0f5a8e36cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.366408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a193-6c19-4268-a081-0f5a8e36cd1a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.366867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a193-6c19-4268-a081-0f5a8e36cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.367713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558a193-6c19-4268-a081-0f5a8e36cd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.424554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05465-f7f3-44d7-883f-b667895a80e7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.459203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a193-6c19-4268-a081-0f5a8e36cd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.460273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.460989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.461332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.461669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.461861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558a193-6c19-4268-a081-0f5a8e36cd1a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.462515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7514901da21f40398a0143744fd11757, user.id=844c5874363b4611b64c3ffa2dc1033c) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:26.462885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.464384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.475876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 438/864] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:26 2022] GET /identity/v3/role_assignments?user.id=844c5874363b4611b64c3ffa2dc1033c&scope.project.id=7514901da21f40398a0143744fd11757&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:26.584368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 427/865] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:26.590088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:26.679792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0174a2-503d-4bf1-ba83-56cd70e0e1c2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.679987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0174a2-503d-4bf1-ba83-56cd70e0e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.680271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0174a2-503d-4bf1-ba83-56cd70e0e1c2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.681631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 428/866] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:26.686077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.687939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.688221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.688494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.708982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63661c15-bff3-4088-ae47-a967b646c19c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.720237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:26.722166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:26.748647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.752640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.753396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.753672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.753941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.768127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.769622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:26.792191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:26.793404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:26.794500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:26.794500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:26.794500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:26.796873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 439/867] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:26.800518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:26.813262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 429/868] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:26.900274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457cd44-915c-4d68-8e39-02f89f0177ec None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:26.929049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:26.934387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:26.935161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:26.935575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:26.935998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:26.936771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:26.937233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:26.938741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:26.951143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 440/869] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:26.956844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:27.060605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa705ec-73b8-4f50-9315-69acb70a8093 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:27.081247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:27.099065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:27.100094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:27.100846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:27.101257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:27.110143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:27.112206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:27.127599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:27.128705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:27.129860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:27.132497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 430/870] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:27.137856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:27.153226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:27.198706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dee887-f5d7-43e3-8de4-3ab6e4aae2a5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:27.235500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:27.236241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:27.236571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:27.236871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:27.237681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:27.239126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:27.257400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fdb58-053a-4c05-80a3-9ef8fb744afe None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:27.264839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 441/871] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:27 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:54:27.308265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:27.309369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:27.309811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:27.310093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:27.310816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:27.311108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:27.312589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ab98-b07b-4d76-9446-75a80ba5f2a9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:27.329107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 431/872] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:27.335571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:27.394214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:27.447776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4636-31c2-44d9-88a4-8d0ee2dcf52a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:27.481789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:27.482395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:27.482677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:27.482950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:27.483682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=d23ba460295c4b9a85db43e43081a595) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:27.483988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:27.485519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716af22-c2cd-4767-8ab7-ee3142ea2490 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:27.491934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 442/873] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:27 2022] GET /identity/v3/role_assignments?user.id=d23ba460295c4b9a85db43e43081a595&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:27.557763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41d116-d3b0-4495-ac00-76acf08ed92c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:27.558438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41d116-d3b0-4495-ac00-76acf08ed92c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:27.558912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41d116-d3b0-4495-ac00-76acf08ed92c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:27.560841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 432/874] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:27.566524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187948b3-22af-4fbd-9393-c033051627cb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:27.566873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187948b3-22af-4fbd-9393-c033051627cb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:27.567154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187948b3-22af-4fbd-9393-c033051627cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:27.591046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-187948b3-22af-4fbd-9393-c033051627cb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:27.592263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-187948b3-22af-4fbd-9393-c033051627cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:27.671202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 443/875] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:27.938848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41d116-d3b0-4495-ac00-76acf08ed92c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:28.007593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:28.045210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41d116-d3b0-4495-ac00-76acf08ed92c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:28.080363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad73b-cdca-4c3c-bf7f-fa9b695dc9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:28.081000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad73b-cdca-4c3c-bf7f-fa9b695dc9a2 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:28.081275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad73b-cdca-4c3c-bf7f-fa9b695dc9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:28.081539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad73b-cdca-4c3c-bf7f-fa9b695dc9a2 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:28.082228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad73b-cdca-4c3c-bf7f-fa9b695dc9a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:28.083597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad73b-cdca-4c3c-bf7f-fa9b695dc9a2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:28.101748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 433/876] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:27 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:28.528700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a5bd-49c7-4623-8c5b-767a8c3363ad None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:28.529279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a5bd-49c7-4623-8c5b-767a8c3363ad None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:28.529279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95a5bd-49c7-4623-8c5b-767a8c3363ad None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:28.530849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 444/877] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:28.536416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:28.536704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:28.537025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:28.555480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:28.556669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:28.634290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 434/878] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:28.893679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a5bd-49c7-4623-8c5b-767a8c3363ad None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:28.944238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:29.007164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95a5bd-49c7-4623-8c5b-767a8c3363ad None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:29.044992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:29.045987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.046464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.046959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.047748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:29.049360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:29.058531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:29.059543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:29.060387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:29.063079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 445/879] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:29.069222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:29.130131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:29.176926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122377-69c4-4e28-84c1-a5c16398ce76 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:29.211657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:29.212280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.212557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.212848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.213499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:29.213798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:29.215225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4e2c7-4b5e-4949-8289-ba695a34dcda None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:29.224975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 435/880] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:29.229946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:29.258757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83faa3-2966-4578-a966-bd6dc70fe17d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.259043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83faa3-2966-4578-a966-bd6dc70fe17d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.259295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83faa3-2966-4578-a966-bd6dc70fe17d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.264374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 436/881] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:29.265465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8cb3-af50-4865-afdd-8071d25cf2dc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.265744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8cb3-af50-4865-afdd-8071d25cf2dc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.266016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8cb3-af50-4865-afdd-8071d25cf2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.283548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e7bd8cb3-af50-4865-afdd-8071d25cf2dc None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:29.284709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e7bd8cb3-af50-4865-afdd-8071d25cf2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:29.362176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 437/882] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:29.362438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec946-5d2b-428d-bda6-707eefad5eb6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:29.378931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:29.403558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:29.404454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.404939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.405389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.406211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:29.406742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:29.408324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da33b7-fd9e-497c-9412-f70e9c5d340e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:29.420976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 446/883] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:29.565972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f751-9beb-437e-b73c-33fc218b3b37 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.566276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f751-9beb-437e-b73c-33fc218b3b37 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.566749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f751-9beb-437e-b73c-33fc218b3b37 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.568502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 438/884] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:29.573719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.574159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.574302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.592885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:29.594582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:29.629269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267f751-9beb-437e-b73c-33fc218b3b37 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:29.674364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 447/885] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:29.685832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:29.742059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267f751-9beb-437e-b73c-33fc218b3b37 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:29.781510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:29.782253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.782532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.782800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.783385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:29.784827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:29.794189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:29.795165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:29.796661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 439/886] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:29.801285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:29.900176 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07463b-e93c-4ae4-b594-bd52cdf34f1f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:29.902449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:29.934129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:29.934739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:29.935013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:29.935280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:29.935907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:29.936206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:29.937595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:29.942902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 448/887] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:29.943904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:29.948337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.053509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11dec-13dc-44d0-8349-2e53e67adc0a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.056294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149dbb2-ed89-47da-8bb4-585d54a9ff63 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.069676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.092003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.092240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a28732-9c63-4918-9845-7817101e63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.092617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.092727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28732-9c63-4918-9845-7817101e63cc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.092918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.093016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28732-9c63-4918-9845-7817101e63cc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.093177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.093284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28732-9c63-4918-9845-7817101e63cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.093819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:30.094120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.095649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.101429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 449/888] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:30.106833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.110118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a28732-9c63-4918-9845-7817101e63cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-57a28732-9c63-4918-9845-7817101e63cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:30.116903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:30.117911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:30.118792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 440/889] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Aug 31 03:54:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:30.120720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f964949-255f-49c3-8e95-97b39d923ba2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.120850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f964949-255f-49c3-8e95-97b39d923ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.124592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f964949-255f-49c3-8e95-97b39d923ba2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.124592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 441/890] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:30.125509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f964949-255f-49c3-8e95-97b39d923ba2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.143056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.209086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18006622-2d65-4036-a19a-5574c01e365b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.237217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f964949-255f-49c3-8e95-97b39d923ba2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.241312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.241919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.242194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.242461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.243153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] RBAC: Adding query filter params (interface=public, service_id=8daff766ab624a959f59bbcf2a3b6d12, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:30.243455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.244828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e3b33-9af9-43f1-be6c-2962f65de6d2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.250100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 450/891] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/endpoints?service_id=8daff766ab624a959f59bbcf2a3b6d12&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:30.251213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.251486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.251751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.270158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:30.271325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:30.283568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.284354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.284778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.285379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.286062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:30.286474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.287902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.301398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 442/892] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:30.302177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.337574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.338718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 451/893] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:30.339346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.370326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.416344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0b477-899a-4001-a20b-facd4f87b041 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.446486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3d19-fbf0-4451-9ff3-3abcbf215fde None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.451503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.452117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.452391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.452656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.453323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.454845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.468914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 443/894] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:54:30.493401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.494111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.494384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.494651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.506937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.508456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:30.524692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:30.525760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:30.526685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:30.526685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:30.526685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:30.526685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 452/895] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:30.531826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.637787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.642940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.647071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8803d9-ec9d-4291-8c45-a608dbae836b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.695482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.696139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.696385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.696648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.697907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:30.698215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.702052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.720922 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 444/896] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:30.722845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.747879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.772216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e408bf-bbb9-4e41-a297-0166a5d0aad3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.807750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.808629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.809194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.809602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.810353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.811976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:30.821363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:30.822350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:30.823216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:30.826048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 453/897] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:30.832015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.837086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa1dc2-ac9c-4276-8d59-c61b22c8a4bc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:30.874849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:30.875636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:30.875919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:30.876242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:30.884987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:30.886743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:30.899186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:30.900147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:30.901125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:30.905148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 445/898] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:30.906047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:30.928213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:30.960987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc2bd-258b-4829-9517-67305a0229b2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.014968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.016191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.016648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.017121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.017804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233f49e-566b-4c5f-930e-789fca404fb0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.018148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:31.018620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.021101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.030936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 454/899] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:31.036057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.050650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.070449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.071151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.071395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.071673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.072526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:31.072859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.074513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.099141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 446/900] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Aug 31 03:54:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:31.100232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.150905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027b3c1-9cbd-4e17-a934-ad27ebc7d155 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.185118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.186451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.187377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.187881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.188344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.189259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:31.189758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.191328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.201461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 455/901] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:31.202629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.211520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28118a1e-0485-4e6c-ac0c-2d569daefbeb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.249197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3789410-ccde-40f4-b089-5e56314bb1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.249976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3789410-ccde-40f4-b089-5e56314bb1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.250290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3789410-ccde-40f4-b089-5e56314bb1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.250574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3789410-ccde-40f4-b089-5e56314bb1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.275043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.306997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3ae3f-d0fd-4170-92f1-121709064f64 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.328096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3789410-ccde-40f4-b089-5e56314bb1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.329986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3789410-ccde-40f4-b089-5e56314bb1e3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.344210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.345224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.345700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.346175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.347099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] RBAC: Adding query filter params (interface=public, service_id=5f33a24ec1c4443ab93d4a3d1135e196, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:31.347601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.349476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.359555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 456/902] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/endpoints?service_id=5f33a24ec1c4443ab93d4a3d1135e196&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:31.360710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.413302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.437298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 447/903] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:31.438927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299d57-cfcf-47c3-b30f-6728e4500345 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.439416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299d57-cfcf-47c3-b30f-6728e4500345 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.439886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299d57-cfcf-47c3-b30f-6728e4500345 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.445459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 448/904] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:31.445459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299d57-cfcf-47c3-b30f-6728e4500345 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.468062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fe69e-fee3-475c-9f0c-5ff507c93525 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.506958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08eafb-f33c-41d1-8ba4-00427d77c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.507569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08eafb-f33c-41d1-8ba4-00427d77c080 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.507849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08eafb-f33c-41d1-8ba4-00427d77c080 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.508120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08eafb-f33c-41d1-8ba4-00427d77c080 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.508731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08eafb-f33c-41d1-8ba4-00427d77c080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.510121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08eafb-f33c-41d1-8ba4-00427d77c080 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.511180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.523483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 457/905] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:54:31.523483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.523483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.523483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.539280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:31.540417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:31.570065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299d57-cfcf-47c3-b30f-6728e4500345 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.619709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.620459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.620734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.621056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.626112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 458/906] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:31.637441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.638965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:31.655516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:31.656547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:31.657492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:31.657492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:31.657492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:31.657492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 449/907] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:31.663846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.775873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd2e6-6e35-4766-8adf-05201d3446e5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:31.803401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.812187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:31.812794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:31.813106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:31.813377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:31.814022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:31.814319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:31.815689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:31.827645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 459/908] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:31.833186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.863324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:31.896170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:31.957103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4059b9-b0b7-489e-b935-95625571c310 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:32.001974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:32.003562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.004508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.005011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.015695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:32.018065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:32.021346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd0e36-69b5-41b5-b019-27c74102323c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:32.033496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:32.034511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:32.035534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:32.037994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 450/909] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:32.043692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:32.070263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:32.070846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.071125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.071393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.072073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:32.074205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:32.094878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 460/910] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:31 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:54:32.152541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:32.173481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e1295-09b2-4464-ab89-287120d90eb2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:32.221331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:32.221956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.222231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.222498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.223249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:32.223604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:32.225079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103a9d6-4256-4733-8f6a-d3221f58b69e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:32.238668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 451/911] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:32.244304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:32.304438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:32.365821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18dcfa-4540-406a-941e-cdd19e73883d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:32.402309 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:32.402915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.403192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.403460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.404189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] RBAC: Adding query filter params (role.id=39faf6e8871f4cf79239f8beca4e7603, scope.project.id=7514901da21f40398a0143744fd11757, user.id=d23ba460295c4b9a85db43e43081a595) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:32.404494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:32.405962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1fcb-0d09-42d4-9e0e-5bdfa52039ff None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:32.411919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 461/912] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:32 2022] GET /identity/v3/role_assignments?user.id=d23ba460295c4b9a85db43e43081a595&scope.project.id=7514901da21f40398a0143744fd11757&role.id=39faf6e8871f4cf79239f8beca4e7603 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:32.463204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f0d5-24f5-464e-bf3b-7396c08ae289 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.463503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f0d5-24f5-464e-bf3b-7396c08ae289 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.463768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f0d5-24f5-464e-bf3b-7396c08ae289 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.465422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 452/913] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:32.471344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.471941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.472431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.492999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:32.494226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:32.568913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 462/914] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:32.832455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6f0d5-24f5-464e-bf3b-7396c08ae289 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:32.935234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6f0d5-24f5-464e-bf3b-7396c08ae289 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:32.969579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:32.970138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:32.970415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:32.970688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:32.971266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:32.972849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:32.981719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:32.982720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:32.983609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 453/915] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:32.991061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:33.039179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:33.102577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427781c7-a350-4860-b9cc-6039ed4a56f2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:33.137438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:33.138056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:33.138331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:33.138602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:33.139231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:33.139530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:33.140914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:33.146098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 463/916] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:33.153925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:33.166257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:33.261574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628ffbe-717d-4e5e-88a3-0acda15d4891 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:33.297784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:33.298405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:33.298681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:33.298951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:33.299589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:33.299887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:33.301400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20306cff-9264-4b1a-bf29-2316116e8caa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:33.306754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 454/917] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Aug 31 03:54:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:33.313911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:33.416286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6fd36-71d2-4545-9e5b-bfaacedd34ff None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:33.423852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:33.451252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cebad-0e50-46b8-bb92-4d9a057a9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:33.451862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cebad-0e50-46b8-bb92-4d9a057a9e92 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:33.452139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cebad-0e50-46b8-bb92-4d9a057a9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:33.452409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cebad-0e50-46b8-bb92-4d9a057a9e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:33.453104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cebad-0e50-46b8-bb92-4d9a057a9e92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:33.454532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cebad-0e50-46b8-bb92-4d9a057a9e92 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:33.476780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 464/918] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:33.557404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686a91-5b96-4c73-be42-b08410d33f35 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:33.557585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686a91-5b96-4c73-be42-b08410d33f35 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:33.557863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686a91-5b96-4c73-be42-b08410d33f35 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:33.559589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 455/919] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:33.565322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:33.565619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:33.565880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:33.585105 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:33.586313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:33.667597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 465/920] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:33.929290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686a91-5b96-4c73-be42-b08410d33f35 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.002013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:34.035378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686a91-5b96-4c73-be42-b08410d33f35 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.069544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.070184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.070462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.070735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.071321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:34.072747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-86674d66-8047-4103-ad53-9e5ade23bee6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:34.082055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:34.083014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 03:54:34.083930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:34.088177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 456/921] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Aug 31 03:54:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:34.089632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.177888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa5067-e6a3-4565-a900-0e5134674774 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.178559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa5067-e6a3-4565-a900-0e5134674774 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.178559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa5067-e6a3-4565-a900-0e5134674774 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.180102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 457/922] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:34.181958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:34.186286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbd49-322f-4c29-a66e-288121ade93d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.186571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbd49-322f-4c29-a66e-288121ade93d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.186846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbd49-322f-4c29-a66e-288121ade93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.196278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699e482-0586-4047-84f7-cd1d4b466200 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.208423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6a3bbd49-322f-4c29-a66e-288121ade93d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:34.209918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6a3bbd49-322f-4c29-a66e-288121ade93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:34.232895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.233634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.233920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.234192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.234823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:34.235124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:34.236490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:34.244837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 466/923] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:34.247747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.290009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 458/924] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:34.353216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368c482-4099-4804-b7ee-2c8b6d424280 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.367078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176247-0d07-457c-bc97-2a6db96f5bb5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.367365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176247-0d07-457c-bc97-2a6db96f5bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.367616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc176247-0d07-457c-bc97-2a6db96f5bb5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.370505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 459/925] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:34.376271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.376781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.377597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.394771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.395472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.395758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.396034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.396669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:34.397011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:34.397325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:34.398367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:34.398979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:34.403989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 467/926] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:34.413924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.432967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:34.466178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:34.480832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 460/927] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:34.529672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5487b-99e5-4a3f-a16f-b5e9b260198b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.563026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.565757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.566401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.566685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.566960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.567632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:34.569025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:34.599881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 468/928] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:34.688197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab685d-7659-4206-b70e-71dc3c498e81 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.733047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.733901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.734180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.734451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.735108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:34.736563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:34.746647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:34.747675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:34.748512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:34.750095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.753051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 461/929] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:34.754465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.826398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:34.836645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:34.873816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2033fa-336b-4946-a580-3f7d01c393f1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.889354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11a987-36a4-453a-b67b-3f23de1dd2f2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:34.914203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.914844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.915119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.915390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.926258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:34.931907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:34.933045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:34.934384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 469/930] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:34.935647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:34.936440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:34.936887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:34.937299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:34.938140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:34.938626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:34.938756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:34.940260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:34.947215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 462/931] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:34.952390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.059732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6aaeb-f684-401b-b115-c500e8b9a038 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.080794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afbad-11ff-43fb-90dd-f52dffcf70c8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.100293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:35.103439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:35.109475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.110569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.110850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.111125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.111856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:35.112337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.114713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.129287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 470/932] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:35.130013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.130655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.130932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.131202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.131848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:35.132151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.133573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.134006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.144901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 463/933] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:35.146883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.251373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d16f8-6bd0-4259-9155-a9637a2d4996 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.268652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb3127-ed44-49de-8ac8-4916f0c37ab6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.290367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.291316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.291814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.292292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.293239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] RBAC: Adding query filter params (interface=public, service_id=240155ff937b4ab7bcce3179fd67296b, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:35.293742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.295379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.301600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 464/934] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/endpoints?service_id=240155ff937b4ab7bcce3179fd67296b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:35.306696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.315208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.315851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.316130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.316439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.330784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.333104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:35.351863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:35.352886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:35.353788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:35.353788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:35.353788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:35.353788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 471/935] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:35.360046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.367899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:35.423021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:35.436481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56fd9-f8c0-425e-8a7d-d946264f157d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.480427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4466d6-17d2-4eb9-80e6-898ffe270c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.481219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4466d6-17d2-4eb9-80e6-898ffe270c47 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.481501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4466d6-17d2-4eb9-80e6-898ffe270c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.481854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4466d6-17d2-4eb9-80e6-898ffe270c47 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.482468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4466d6-17d2-4eb9-80e6-898ffe270c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.484488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4466d6-17d2-4eb9-80e6-898ffe270c47 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.490599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d777de-7e57-452e-a0aa-d0c83fc6aba3 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.492951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 465/936] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:54:35.507109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49418-a6cb-4bcf-8bbf-ad431da2c496 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.507422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49418-a6cb-4bcf-8bbf-ad431da2c496 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.507663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49418-a6cb-4bcf-8bbf-ad431da2c496 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.509483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 466/937] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:35.514950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.515580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.516040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.535792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:35.537412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:35.539250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.539919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.540339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.540688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.541285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:35.541629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.543065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.560985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 472/938] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:35.562233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.637285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 467/939] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:35.688197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41f64e-5dcb-4672-a603-34616abe0387 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.701330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:35.736391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.737473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.737985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.738505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.747437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.749324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:35.762561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:35.763544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:35.764498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:35.767382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 473/940] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:35.775243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.820977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:35.878630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de9c2-93d6-44d6-a346-5ea7e2ef0c3c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:35.906737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:35.913322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:35.913945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:35.914226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:35.914494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:35.915239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:35.915542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:35.917004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:35.934618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 468/941] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:35.939918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.025585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7687f12-f55f-4b81-8366-59ccb2d0fe95 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.044519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:36.047690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd373eb0-f459-493a-9386-27cd365d9f67 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.072928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.074047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.074472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.075109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.076308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.078400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.082549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING keystone.server.flask.common [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 03:54:36.087295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.087929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.088274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.088618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.099331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.101192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.105606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.sql.core [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 03:54:36.105606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 03:54:36.105606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [parameters: {'id': 'fd1c1bb062c84aa69a7ffe5f84f1a95e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 03:54:36.105606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:36.118348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:36.119509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:36.120607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:36.120607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:36.120607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:36.121456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 469/942] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd1c1bb062c84aa69a7ffe5f84f1a95e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd1c1bb062c84aa69a7ffe5f84f1a95e. Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 03:54:36.126575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 03:54:36.127712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application yield resource Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise self.value Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application session.commit() Aug 31 03:54:36.128649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.flush() Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application compat.raise_( Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 03:54:36.129680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 03:54:36.131376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 03:54:36.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [parameters: {'id': 'fd1c1bb062c84aa69a7ffe5f84f1a95e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.136203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:36.138298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd1c1bb062c84aa69a7ffe5f84f1a95e. Aug 31 03:54:36.140375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.141518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.141669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 474/943] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Aug 31 03:54:35 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:36.141669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.170966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:36.255330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2556ac2-59b8-4192-a4b5-f3110daa955b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.265331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3560a-9911-4186-a157-0b486b3a1a4d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.293282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.293896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.294232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.294466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.301669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.302003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.302756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.303222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.303681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.303793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.304613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:36.305136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.306830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:36.316192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:36.317252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:36.318128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:36.326423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 475/945] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:36.326423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.326839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 470/945] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:36.327907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.343191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:36.413416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:36.436164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5faa-429e-436a-948e-95773ed17f25 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.439348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b695d-2f8e-4cc6-98f1-e3bc5ad5a7c0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.472662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.473314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.473654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.474032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.474706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:36.475010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.476374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.476629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.477428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.477893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.478399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.485618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.487297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.498162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 476/946] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3cf803df-ca95-4ab9-a4a7-6d4035dfebaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:36.499427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:36.500302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:36.501217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:36.508500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 471/947] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:36.511260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.623724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a175-d2fe-4c81-ad77-eef95925995a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.623907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a175-d2fe-4c81-ad77-eef95925995a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.624173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2a175-d2fe-4c81-ad77-eef95925995a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.625740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 472/948] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:36.629244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1b9a9-f77f-431a-9e60-2b68b723adaa None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.631460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.631756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.632035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.651345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:36.653183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:36.675462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.676220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.676495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.676764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.677524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:36.677803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.679897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.692783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 477/949] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:36.698817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:36.704691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:36.752836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 473/950] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:36.820627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba2e3-8ffe-42e5-921c-02903d7b2a2b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:36.854161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:36.854818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:36.855091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:36.855355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/d23ba460295c4b9a85db43e43081a595/roles/39faf6e8871f4cf79239f8beca4e7603` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:36.857639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=d23ba460295c4b9a85db43e43081a595, role_id=39faf6e8871f4cf79239f8beca4e7603)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:36.859057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:36.875737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 478/951] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:36 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/d23ba460295c4b9a85db43e43081a595/roles/39faf6e8871f4cf79239f8beca4e7603 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:54:37.023725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:37.026679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:37.131176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49fc8-3def-4677-8735-e6f1bde43f2a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:37.167673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:37.168705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:37.169209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:37.169702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:37.170481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:37.172101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:37.181268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:37.182308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:37.183189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:37.186293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 474/952] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:37.194072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:37.254480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:37.294468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a801a0-c69a-45a0-8ec7-777189174b73 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:37.328074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:37.328681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:37.328989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:37.329259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:37.329883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:37.330182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:37.331602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987ff54-ab23-4ef7-b572-6593c8acff28 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:37.336855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 479/953] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:37.342591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:37.420119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:37.445599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda92b2-aa8f-4a10-b9ed-f38a59c51589 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:37.479101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:37.479716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:37.479989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:37.480258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:37.480912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:37.481213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:37.482735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b64b51-553d-4b19-abd7-05a080538e4e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:37.487562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 475/954] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:37.518746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230461-6b16-431c-85ef-6c75c69a492b None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:37.519075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230461-6b16-431c-85ef-6c75c69a492b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:37.519285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87230461-6b16-431c-85ef-6c75c69a492b None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:37.520822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 480/955] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:37.526779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:37.527115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:37.527320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:37.547119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:37.548320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:37.621707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 476/956] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:37.889076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230461-6b16-431c-85ef-6c75c69a492b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:37.992005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87230461-6b16-431c-85ef-6c75c69a492b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:38.018652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:38.028213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:38.028897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.029172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.029438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.030166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:38.031472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:38.041603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:38.042736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:38.043662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 481/957] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:38.048880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:38.107623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:38.150960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc24cdb-f002-44bc-858a-df06336b9339 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:38.190834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:38.191477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.191750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.192018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.192706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:38.192976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:38.194339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:38.199480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 477/958] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:38.205126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:38.306290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba052ac3-36da-4969-a80e-29ea011296e1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:38.340545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:38.341238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.341516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.341777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.342400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:38.342697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:38.344047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac8114-4eb7-4052-8a06-3057384aaf97 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:38.349314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 482/959] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:38.355024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:38.454978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59410f58-4ac7-4f3b-bac5-cb67f2c29499 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:38.478689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:38.490038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350ed3-fedb-4899-8607-b9e1de8d84fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:38.490650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350ed3-fedb-4899-8607-b9e1de8d84fc None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.490923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350ed3-fedb-4899-8607-b9e1de8d84fc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.491190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350ed3-fedb-4899-8607-b9e1de8d84fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.491877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350ed3-fedb-4899-8607-b9e1de8d84fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:38.493295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350ed3-fedb-4899-8607-b9e1de8d84fc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:38.521171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 478/960] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:38.643352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d06e7-a38f-499f-81e5-a97548b227d3 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.643541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d06e7-a38f-499f-81e5-a97548b227d3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.643806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d06e7-a38f-499f-81e5-a97548b227d3 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.645500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 483/961] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:38.650973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63140cae-a426-46d3-8ada-172c4936586c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.651544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63140cae-a426-46d3-8ada-172c4936586c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.652018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63140cae-a426-46d3-8ada-172c4936586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.671971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-63140cae-a426-46d3-8ada-172c4936586c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:38.673546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-63140cae-a426-46d3-8ada-172c4936586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:38.750649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 479/962] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:38.879968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada86436-512a-4dcc-85b7-adcdda229311 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.880318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada86436-512a-4dcc-85b7-adcdda229311 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.880512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada86436-512a-4dcc-85b7-adcdda229311 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.882166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 484/963] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:38.887382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:38.887671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:38.887948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:38.906714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:38.907821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:38.977611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 480/964] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:39.038483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada86436-512a-4dcc-85b7-adcdda229311 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.097059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:39.144198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada86436-512a-4dcc-85b7-adcdda229311 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.178643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.179184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.179462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.179734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.180391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:39.181993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:39.198169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.sql.core [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 03:54:39.198169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 03:54:39.198169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [parameters: {'user_id': 'f1132e3a6c7c44b49bf4e8d27675e84b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 03:54:39.198169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81521) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Aug 31 03:54:39.205303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 03:54:39.206626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application yield resource Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application next(self.gen) Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise self.value Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application session.commit() Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 03:54:39.207749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.session.flush() Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application compat.raise_( Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 03:54:39.208722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 03:54:39.211746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application conn.query(q) Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application result.read() Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 03:54:39.213837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f1132e3a6c7c44b49bf4e8d27675e84b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:39.215820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 03:54:39.226437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.228656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 485/965] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Aug 31 03:54:39 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:39.229617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.243852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.249667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:39.322441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a706ac-7452-45b6-9765-f638afef2d7d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.361920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.363520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.363996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.364471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.366000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a7ab4-606c-4304-96f3-41c17089a13a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.372716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:39.374445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:39.386241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:39.389630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:39.390811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 03:54:39.391851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:39.395267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 481/966] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:39.400897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.413471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.414565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.414854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.415131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.428898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:39.435937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:39.436932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.437804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 486/967] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:39.443110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.508791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:39.516505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae706a14-6a57-4423-82fb-2e98fa298537 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.550196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.550827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.551125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.551367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.552069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:39.552369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:39.553843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd534e-ab4f-4e9c-a8df-b7d968654ea8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:39.554640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec026-6643-4699-a485-2ad13f5644d6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.589300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 482/968] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:39.589769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.590383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.590649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56c227-1bfd-4285-8000-000c26eea210 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.590755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.590948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.591056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56c227-1bfd-4285-8000-000c26eea210 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.591211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56c227-1bfd-4285-8000-000c26eea210 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.591592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:39.591896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:39.592564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 483/969] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:39.597840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:39.598636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.599148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.599990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.615696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 487/970] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:39.621957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.628188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:39.629813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:39.677490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:39.714570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 484/971] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:39.753960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4aa52-4979-43e6-931e-f987eaff719d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.787663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.788301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.788579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.788880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.801043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:39.802492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:39.816961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:39.817939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:39.818849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:39.818849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:39.818849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:39.818849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 488/972] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:39.823980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.910067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:39.927507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3ff2e-514e-49fa-a0d6-94bff240e923 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:39.961428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:39.961967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:39.962244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:39.962515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:39.963155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:39.963454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:39.964889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:39.975701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:39.976994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 485/973] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:39.982301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:40.067759 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:40.077876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf790d-b29d-44ba-a13a-18053c683de6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:40.090772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee97e2d-d824-4cf5-91af-af8cacc38fea None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:40.112145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:40.112767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.113083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.113358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.114024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:40.115395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:40.132216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:40.136867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.136867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.136867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.137183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 489/974] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:39 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:54:40.149666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:40.151667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:40.164706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:40.165872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:40.167228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 486/975] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:54:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:40.171782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:40.294277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb78f2-e804-4ea5-b80e-542e5c54cc26 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:40.331653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:40.332307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.332584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.332920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.333660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:40.334018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:40.335441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed38d96-7077-4954-8f8c-f96fbd436f67 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:40.352999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 490/976] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Aug 31 03:54:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:40.358491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:40.362412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:40.460890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f4032-4551-4e4a-a172-e8e1809585b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:40.494395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:40.495005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.495280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.495548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.548384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2f6a-4221-4467-a845-6ce7b68b7c66 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.548585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2f6a-4221-4467-a845-6ce7b68b7c66 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.548862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2f6a-4221-4467-a845-6ce7b68b7c66 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.550206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 491/977] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:40.555229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.555547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.555846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.563071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:40.565401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:40.566928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:40.569796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:40.577363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:40.579101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:40.655452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 492/978] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:40.678420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 487/979] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:40 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:40.684689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:40.800399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d81f-2054-4c14-9b89-8640e0dec257 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:40.835638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:40.836318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:40.836597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:40.836897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:40.838813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:40.848345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:40.849818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:40.864482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:40.865582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:40.871433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:40.871433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:40.871433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:40.871433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 493/980] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:40.873192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:40.913710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:40.978470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b719c-d170-4407-bfc9-34b471502ed7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:40.980833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:41.014243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.014862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.015149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.015414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.016062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:41.016372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.017801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.022580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5021f-43c6-4aba-aa1f-4c4b27e2dea0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.029282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 488/981] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:41.034707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.060590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.061609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.062037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.062591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.063206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.064573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:41.073841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:41.075057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:41.076514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 494/982] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:41.080838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.138145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:41.147387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f2115-6b20-4e43-97db-3a64cfe4b38b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.182846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.183488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.183769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.184039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.190932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.192424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.193523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65a41-e6f5-4938-a3fa-9b39bf5c9c75 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:41.203872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:41.210578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 489/983] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:41.211860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.238624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:41.241130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.242018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.242916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.243196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.243839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:41.244139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.245548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.255509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 495/984] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:41.256488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.321767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b3fb3-1d61-443e-ab9b-a34eeaae54fd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.356543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6a7f-3c6b-4fec-bdeb-7dd6c6de072f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.360776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.361419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.361697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.361967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.362661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:41.363190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.364439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.372111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:41.377742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 490/985] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:41.383458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.396538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.397187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.397468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.397739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.398372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:41.398674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.400029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.409662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 496/986] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:41.410654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.478471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:41.497696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0350-6086-4f93-a6b0-07536c4c036b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.511756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caa8b0-9a18-4a61-8d72-2e0dcf30b94c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.536252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.537343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.537852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.538316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.539125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] RBAC: Adding query filter params (role.id=39faf6e8871f4cf79239f8beca4e7603, scope.project.id=7514901da21f40398a0143744fd11757, user.id=d23ba460295c4b9a85db43e43081a595) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:41.539547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.541261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.545324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.545945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.546219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.546490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.547193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] RBAC: Adding query filter params (interface=admin, service_id=240155ff937b4ab7bcce3179fd67296b, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:41.547502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.556927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 491/987] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/role_assignments?user.id=d23ba460295c4b9a85db43e43081a595&scope.project.id=7514901da21f40398a0143744fd11757&role.id=39faf6e8871f4cf79239f8beca4e7603 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:41.557141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165cfeb-79c2-4e81-b1ac-ca7645251ceb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.561969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 497/988] 10.222.0.25 () {56 vars in 1249 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/endpoints?service_id=240155ff937b4ab7bcce3179fd67296b&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:41.567957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:41.685203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388cb2c-798f-4795-ac30-07f7333a9cd8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:41.729614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124616f-fb39-470c-ac3a-815f0ad9edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:41.730224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124616f-fb39-470c-ac3a-815f0ad9edc1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:41.730491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124616f-fb39-470c-ac3a-815f0ad9edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:41.730757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124616f-fb39-470c-ac3a-815f0ad9edc1 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:41.731381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124616f-fb39-470c-ac3a-815f0ad9edc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:41.732755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124616f-fb39-470c-ac3a-815f0ad9edc1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:41.739172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 492/989] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:41 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:54:42.042913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d61e6-a9f9-4164-8917-fbaa3dba682f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:42.043201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d61e6-a9f9-4164-8917-fbaa3dba682f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:42.043463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d61e6-a9f9-4164-8917-fbaa3dba682f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:42.044833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 498/990] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:42.050246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:42.050536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:42.050874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:42.069565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:42.070744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:42.078509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:42.140187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 493/991] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:42.405037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d61e6-a9f9-4164-8917-fbaa3dba682f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:42.452363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:42.511769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d61e6-a9f9-4164-8917-fbaa3dba682f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:42.545970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:42.546594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:42.546866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:42.547136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:42.547714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:42.549091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:42.557827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:42.558787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:42.559658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 499/992] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:42.565048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:42.670533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c19fd-91b7-49fd-95db-22b2c5aca178 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:42.715075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:42.715699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:42.715950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:42.716246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:42.716887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:42.717187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:42.718571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:42.723860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 494/993] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:42.729868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:42.837081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8297ae-9387-4245-a891-b1050c965ad9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:42.844191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:42.873841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:42.874451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:42.874724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:42.874989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:42.875614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:42.875909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:42.877612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:42.887330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 500/994] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:42.888909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:42.897893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:42.995271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3278-ba17-494f-abb2-8c50575a7539 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:43.028707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:43.029343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.029626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.029892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.030589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] RBAC: Adding query filter params (interface=public, service_id=1032c5e37a954ea08be06fbf7bb3735f, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:43.030891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:43.032262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daad7da-071c-416e-9e7f-ddffd3fc65a2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:43.041883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 495/995] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:42 2022] GET /identity/v3/endpoints?service_id=1032c5e37a954ea08be06fbf7bb3735f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:43.043459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:43.149514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dabf70-4eb5-4f17-a538-ad8feb954250 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:43.184738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb8610-4c88-453b-a267-6867bdfc2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:43.185380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8610-4c88-453b-a267-6867bdfc2c88 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.185626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8610-4c88-453b-a267-6867bdfc2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.185915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb8610-4c88-453b-a267-6867bdfc2c88 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.186511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb8610-4c88-453b-a267-6867bdfc2c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:43.187872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb8610-4c88-453b-a267-6867bdfc2c88 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:43.194756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 501/996] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:43 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:54:43.481718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6201-2b2e-491b-83f9-154b187dbf7d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.481955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6201-2b2e-491b-83f9-154b187dbf7d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.482231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b6201-2b2e-491b-83f9-154b187dbf7d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.483570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 496/997] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:43.489340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd66432-5bde-4992-8811-ffa70cb33191 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.489855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd66432-5bde-4992-8811-ffa70cb33191 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.489855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd66432-5bde-4992-8811-ffa70cb33191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.509581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2bd66432-5bde-4992-8811-ffa70cb33191 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:43.510746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2bd66432-5bde-4992-8811-ffa70cb33191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:43.538873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:43.580695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 502/998] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:43.637192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac2e3-6a22-43c8-98a2-4d3a2da7e9e0 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.637703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac2e3-6a22-43c8-98a2-4d3a2da7e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.637703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac2e3-6a22-43c8-98a2-4d3a2da7e9e0 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.638881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 497/999] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:43.644371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1510-12e7-456b-b698-28612016040b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.644634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1510-12e7-456b-b698-28612016040b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.644970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1510-12e7-456b-b698-28612016040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.663614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1b8f1510-12e7-456b-b698-28612016040b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:43.664788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1b8f1510-12e7-456b-b698-28612016040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:43.746096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 503/1000] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:43.841879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac2e3-6a22-43c8-98a2-4d3a2da7e9e0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:43.914293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:43.952399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac2e3-6a22-43c8-98a2-4d3a2da7e9e0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:43.986103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:43.986724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:43.987047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:43.987308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:43.987928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:43.989334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:43.998167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:43.999130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:44.000019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:44.004629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 498/1001] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Aug 31 03:54:43 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:44.005493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1510-12e7-456b-b698-28612016040b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:44.013341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:44.101710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:44.109665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1510-12e7-456b-b698-28612016040b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:44.118488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfca18-e51c-485a-a8d9-e5eb07c0e5f6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:44.144774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:44.145718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:44.146177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:44.146530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:44.147142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] RBAC: Adding query filter params (name=image) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:44.147445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:44.148789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:44.153794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 504/1002] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:44.157199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:44.157834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:44.158108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:44.158385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:44.158938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:44.159381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:44.160337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:44.162234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:44.171438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:44.172461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 03:54:44.173350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:44.174162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 499/1003] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Aug 31 03:54:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:44.179033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:44.270131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e9d3-a367-4555-9642-d040bcbc9a36 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:44.292597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f284322-5de5-48ec-8c87-0cd167844d32 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:44.306748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:44.307208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:44.307482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:44.307748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:44.308374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] RBAC: Adding query filter params (type=image) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:44.308672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:44.310075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:44.314959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 505/1004] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:44.330315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:44.331077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:44.331417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:44.331815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:44.332527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:44.332918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:44.334405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:44.340403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 500/1005] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:44.346024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:44.373128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:44.457298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c4b0f-78a6-483a-8b10-81f0e5ea1392 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:44.492882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:44.493508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:44.493745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:44.494013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:44.494642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:44.494938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:44.496393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db38a-752d-461c-ae3c-e3ec6bc0a332 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:44.502834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 506/1006] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Aug 31 03:54:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:44.507939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:44.570466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:44.614715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569eb42-23b6-42e5-a46d-81355938fbf9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:44.649894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17983595-3927-4135-90fa-2270189bde87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:44.650539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17983595-3927-4135-90fa-2270189bde87 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:44.650758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17983595-3927-4135-90fa-2270189bde87 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:44.651027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17983595-3927-4135-90fa-2270189bde87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:44.651704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17983595-3927-4135-90fa-2270189bde87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:44.653102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17983595-3927-4135-90fa-2270189bde87 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:44.669986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 501/1007] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:54:45.086158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956cc33-67ab-4a1b-a995-9996b632d681 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:45.086417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956cc33-67ab-4a1b-a995-9996b632d681 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:45.086686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956cc33-67ab-4a1b-a995-9996b632d681 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:45.088195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 507/1008] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:45.093205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:45.093492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:45.093723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:45.112056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:45.113343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:45.189113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 502/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:45 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:45.454939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956cc33-67ab-4a1b-a995-9996b632d681 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:45.545851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:45.562349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956cc33-67ab-4a1b-a995-9996b632d681 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:45.596499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:45.597171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:45.597508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:45.597779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:45.598359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:45.599733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:45.608739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:45.609730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:45.610609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 508/1010] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:45.617591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:45.669503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:45.726350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4993-c5d8-43ee-8f80-50ea2d1150b4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:45.763515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:45.764132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:45.764460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:45.764734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:45.765390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:45.765691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:45.767067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:45.776682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 503/1011] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:45.777845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:45.881692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1889575-d459-41dd-a7a0-2cf811f193c9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:45.914815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:45.915416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:45.915741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:45.916013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:45.916639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:45.916957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:45.918631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ecc45-7cc9-47ee-8648-a39fb3f7db5e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:45.923597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 509/1012] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Aug 31 03:54:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:45.929377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:46.031136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63539d07-9cd1-48e4-ba05-4726ddd9d52f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:46.044641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:46.067331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57d82f-070a-4253-be4b-c0fc8505733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:46.067951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57d82f-070a-4253-be4b-c0fc8505733b None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:46.068222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57d82f-070a-4253-be4b-c0fc8505733b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:46.068485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57d82f-070a-4253-be4b-c0fc8505733b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:46.069195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57d82f-070a-4253-be4b-c0fc8505733b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:46.070561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57d82f-070a-4253-be4b-c0fc8505733b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:46.092058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 504/1013] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:46.216663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a691de-8c55-4e61-bf26-89cf664398c4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:46.217076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a691de-8c55-4e61-bf26-89cf664398c4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:46.217202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a691de-8c55-4e61-bf26-89cf664398c4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:46.218825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 510/1014] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:46.224305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b2d8a-976c-4fe2-8228-c58e85a73847 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:46.224588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b2d8a-976c-4fe2-8228-c58e85a73847 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:46.224903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b2d8a-976c-4fe2-8228-c58e85a73847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:46.244433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-219b2d8a-976c-4fe2-8228-c58e85a73847 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:46.245767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-219b2d8a-976c-4fe2-8228-c58e85a73847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:46.323349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 505/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:46 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:46.568775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f730c61-61f9-4c27-81fe-047fa670a997 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:46.569331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f730c61-61f9-4c27-81fe-047fa670a997 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:46.569331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f730c61-61f9-4c27-81fe-047fa670a997 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:46.570947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 511/1016] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:46.576226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:46.576452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:46.576720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:46.587800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f730c61-61f9-4c27-81fe-047fa670a997 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:46.596605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:46.598283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:46.604191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:46.680577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 506/1017] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:46 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:46.710832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f730c61-61f9-4c27-81fe-047fa670a997 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:46.746943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:46.747770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:46.748246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:46.748724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:46.749422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:46.750788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:46.770181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 512/1018] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:46 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:54:46.951732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:46.977279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:47.055259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52467bd3-1a64-4304-b2c1-5aa6cf5021b7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:47.095317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5842ab-7b28-44ec-9b35-ec4b5ac6a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:47.095953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5842ab-7b28-44ec-9b35-ec4b5ac6a33d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:47.096246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5842ab-7b28-44ec-9b35-ec4b5ac6a33d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:47.096492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5842ab-7b28-44ec-9b35-ec4b5ac6a33d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:47.097736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5842ab-7b28-44ec-9b35-ec4b5ac6a33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:47.099173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5842ab-7b28-44ec-9b35-ec4b5ac6a33d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:47.100934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 507/1019] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:47.106636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:47.183438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:47.211292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544db0b8-2757-4a9d-9ada-29783aef85c5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:47.245747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792cb8-681e-484c-a09c-6de776aa7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:47.246371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792cb8-681e-484c-a09c-6de776aa7a90 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:47.246655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792cb8-681e-484c-a09c-6de776aa7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:47.246927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792cb8-681e-484c-a09c-6de776aa7a90 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:47.247596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86792cb8-681e-484c-a09c-6de776aa7a90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:47.249068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86792cb8-681e-484c-a09c-6de776aa7a90 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:47.284835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 513/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:54:47 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:48.095076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227e990-0414-4c92-b005-716c261c44d6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.095636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227e990-0414-4c92-b005-716c261c44d6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.095636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227e990-0414-4c92-b005-716c261c44d6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.097166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 508/1021] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:48.102487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.102899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.103067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.122075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:48.123266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:48.197504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 514/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:48.463973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227e990-0414-4c92-b005-716c261c44d6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:48.558162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:48.572237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227e990-0414-4c92-b005-716c261c44d6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:48.607491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde972b-1f3e-4355-a0a6-f4473d3f462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:48.608118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde972b-1f3e-4355-a0a6-f4473d3f462d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.608394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde972b-1f3e-4355-a0a6-f4473d3f462d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.608659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde972b-1f3e-4355-a0a6-f4473d3f462d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.619403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde972b-1f3e-4355-a0a6-f4473d3f462d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2fde972b-1f3e-4355-a0a6-f4473d3f462d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:48.624143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:48.628999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:48.629896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 509/1023] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Aug 31 03:54:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:48.632421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:48.663431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadb277-471c-4f8e-8735-484fffce3755 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.663746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadb277-471c-4f8e-8735-484fffce3755 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.663991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadb277-471c-4f8e-8735-484fffce3755 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.665426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 510/1024] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:48.670282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.670561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.670835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.689556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:48.690756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:48.697567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:48.745436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb59b-e5f2-439c-a5f4-a23ba309acac None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:48.776021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 511/1025] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:48.787069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:48.787682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.787939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.788237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.789150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:48.789491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:48.790877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:48.799635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 515/1026] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:54:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:48.805257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:48.884382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:48.907717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fda20-8374-4aae-8f69-0b4ebdfded6c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:48.943279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:48.943916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:48.944168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:48.944440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:48.954782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:48.956231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:48.970946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:48.971917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:48.978148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:48.978148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:48.978148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:48.978148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 512/1027] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:48.979713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.055371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.089120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113718d-3f4e-4778-ba9e-76a511a78028 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.106698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.126301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.127388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.127664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.128742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.129435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:49.129735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.131093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.150297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 516/1028] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:49.152205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.160639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d86017-8050-4bb9-a74d-237585d8b73c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.191088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.197076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.197682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.197974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.198225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] PATH_INFO: `/v3/services/image` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.198808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.200167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-65976349-fa81-4bec-bb78-10160baf53db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:49.208764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:49.209867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:49.211057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 513/1029] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:49.214535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d8ad-93f6-4a5c-8f76-98f8d17534f6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.214822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d8ad-93f6-4a5c-8f76-98f8d17534f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.215094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d8ad-93f6-4a5c-8f76-98f8d17534f6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.216361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 514/1030] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:49.217079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4d8ad-93f6-4a5c-8f76-98f8d17534f6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.257791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b411f38-689c-47c7-8d24-ad0f4413b63a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.291236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.291863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.292139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.292409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.299325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.300751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-caa4f9ac-36c8-41f0-9002-f5ded171a6b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:49.312085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:49.313207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:49.314185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:49.316604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4d8ad-93f6-4a5c-8f76-98f8d17534f6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.318042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 517/1031] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:49.319315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.319599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.319873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.337049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:49.338275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:49.350879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.351516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.351786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.352111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.352747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:49.353070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.354425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.359422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 515/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:49.360197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.369307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.407111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 518/1033] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:49.408076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.418699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.462206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627de66-52af-4a9a-904a-3a728d4cb1b7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.500056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.501174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.501596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.502321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.503191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:49.504059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.506058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.514998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756805-7b9e-4b4a-bf40-d48581b8fec7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.527348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 516/1034] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:49.533357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.549851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.550571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.550848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.551122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.551736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] RBAC: Adding query filter params (type=image) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:49.552031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.553452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.558354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 519/1035] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:49.564165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.595108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.643366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf32e7-7d19-4a2b-a6ad-a6948901b885 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.661106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.663205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d11330-cd5f-4628-af6c-2f652c419b1f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.686037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.686664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.686940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.687318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.703057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.703717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.704026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.704319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.705079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] RBAC: Adding query filter params (interface=public, service_id=9cc56b33317448cab86fc7a82d306a18, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:49.705386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.706819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.712057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 520/1036] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/endpoints?service_id=9cc56b33317448cab86fc7a82d306a18&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:49.712860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.766882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.768334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.806518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.813529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb25ba-4bc2-4b7c-bdc3-34a3b91faf6f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.849815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.850359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.850639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.850897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.852029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.853482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:49.855055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 521/1037] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:49.855813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.872783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 517/1038] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:49.873862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:49.891050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:49.957441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12de2df-c974-4b3d-82b2-c44011d24b87 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.975045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacef4d-494d-4b5b-b21b-bf4eeaa84f6e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:49.993464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:49.994074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:49.994354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:49.994625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:49.995627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:49.997026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.004840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 522/1039] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:54:49 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:54:50.005678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:50.022388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:50.023096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:50.023376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:50.023715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:50.024414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:50.025926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.041208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:50.050165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 518/1040] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:54:49 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:54:50.141388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a38fb-cd7f-4f9a-9a0b-07ba8a8dd3bf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:50.185726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:50.186373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:50.186644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:50.186910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:50.199410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:50.200918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:50.216668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:50.217871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:50.218773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:50.218773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:50.218773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:50.218773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 523/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:50.223644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:50.302849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:50.334885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88c55f-7aa7-46ea-a0cd-ff734744c3ea None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:50.369474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:50.370136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:50.370603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:50.371071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:50.372074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:50.372388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:50.373790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.388831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 519/1042] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:50.395338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:50.485191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:50.509108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee270-d0e3-4295-ad73-4114450f13b1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:50.546371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:50.547259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:50.547715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:50.548128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:50.555718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:50.557345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:50.570728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:50.571861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:50.573721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:50.576881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 524/1043] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:50.579459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:50.697634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a07d45-ebcb-447e-bd82-7be5a156c799 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:50.734421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:50.741273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:50.741907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:50.742161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:50.742450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:50.743153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:50.743457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:50.744911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe5ef2-d561-448a-b6ef-9558ee851a08 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.762706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 520/1044] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:50.764407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:50.874728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c876b1a-383f-4d62-9250-600c0732a17d None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:50.909537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:50.910160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:50.910434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:50.910701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:50.911426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] RBAC: Adding query filter params (role.id=39faf6e8871f4cf79239f8beca4e7603, scope.project.id=7514901da21f40398a0143744fd11757, user.id=15d3488259a0490bb05a0c49688f5957) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:50.911724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:50.913172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e80281-a9ca-42cd-b9b4-5885290e948e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:50.918741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 525/1045] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:50 2022] GET /identity/v3/role_assignments?user.id=15d3488259a0490bb05a0c49688f5957&scope.project.id=7514901da21f40398a0143744fd11757&role.id=39faf6e8871f4cf79239f8beca4e7603 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:51.908816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065aace-187c-48b9-aa70-552b927c692c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:51.909412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065aace-187c-48b9-aa70-552b927c692c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:51.909412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065aace-187c-48b9-aa70-552b927c692c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:51.912845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 521/1046] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:51.915987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d688bab-f317-4485-a257-a910ffb8b376 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:51.916375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d688bab-f317-4485-a257-a910ffb8b376 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:51.916550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d688bab-f317-4485-a257-a910ffb8b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:51.924118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:51.935787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8d688bab-f317-4485-a257-a910ffb8b376 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:51.937160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8d688bab-f317-4485-a257-a910ffb8b376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:52.014527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 526/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:52.036372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0df7f5-1072-4bba-ab4a-9df1bdaf40a7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.036611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0df7f5-1072-4bba-ab4a-9df1bdaf40a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.036951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0df7f5-1072-4bba-ab4a-9df1bdaf40a7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.038437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 522/1048] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:52.043344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.043628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.043901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.062148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:52.063303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:52.130881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 527/1049] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:52.281624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0df7f5-1072-4bba-ab4a-9df1bdaf40a7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.398140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.409275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0df7f5-1072-4bba-ab4a-9df1bdaf40a7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.445238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.445878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.446155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.446423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] PATH_INFO: `/v3/services/image` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.447009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:52.448385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:52.458197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:52.459223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:52.460070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 523/1050] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:52.464712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:52.465303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.505886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0fba1-aa35-4ef2-967b-433196eeaa9d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.537856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:52.547212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.547857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.548137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.548411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.559424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:52.564291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:52.565290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:52.566741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 528/1051] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:52.571373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.590496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff559a8-6e97-4e38-a7a3-0de40d781354 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.628232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.628901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.629178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.629443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.630071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] RBAC: Adding query filter params (name=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:52.630368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:52.631738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:52.637164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 524/1052] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:52.642533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.679094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dac25-8da2-4342-9e84-863815169693 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.709829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:52.722150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.722795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.723072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.723343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.724011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:52.724311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:52.725704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:52.734423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 529/1053] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:52.739936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.754284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105abdc-65fa-4382-ac23-2b50af63e6ce None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.774573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:52.790465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.791143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.791624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.792087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.792917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:52.793232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:52.794603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e895b-1719-4238-8416-dd0826ac27d8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:52.799475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 525/1054] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:52.800624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2560-f1b0-4b67-8368-b0f797da30fe None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.800930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2560-f1b0-4b67-8368-b0f797da30fe None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.801202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2560-f1b0-4b67-8368-b0f797da30fe None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.802379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 526/1055] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:52.805326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf2560-f1b0-4b67-8368-b0f797da30fe None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:52.844027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf8ca7-0c18-4ecb-bf94-57af5a4c26f0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.876443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e788af-621c-48d3-88d7-584c1f13f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.877418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e788af-621c-48d3-88d7-584c1f13f816 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.877695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e788af-621c-48d3-88d7-584c1f13f816 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.877965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e788af-621c-48d3-88d7-584c1f13f816 None admin] PATH_INFO: `/v3/users/bf50696bef274a269ee6ff06570b6f02` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.891244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e788af-621c-48d3-88d7-584c1f13f816 None admin] RBAC: Authorizing `identity:get_user(user_id=bf50696bef274a269ee6ff06570b6f02)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:52.892676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e788af-621c-48d3-88d7-584c1f13f816 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:52.894541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 530/1056] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/users/bf50696bef274a269ee6ff06570b6f02 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:52.895660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.895943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.896212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.909531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf2560-f1b0-4b67-8368-b0f797da30fe None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:52.913231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:52.914439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:52.942766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:52.943334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:52.943610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:52.943878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:52.944543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:52.945939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:52.954563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:52.966002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 527/1057] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:54:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:54:52.966811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.002443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 531/1058] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:53.014801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:53.081162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a37f28-3fdb-4a44-b558-ef454798423a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.117875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.118496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.118776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.119045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.188948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:53.190428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:53.231411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:53.267004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.302294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 528/1059] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:53.303466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.369801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091693-244f-4cfe-9be6-277352a1f86a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.405387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.406046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.406317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.406583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.406686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0dbc0-2555-4ed8-8fd4-3592d05ea22e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.417725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:53.422510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:53.423436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:53.424299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 532/1060] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:53.429523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.445164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.445802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.446075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.446343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.447580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f1feab2840c7439e9a7d97de53e8c8d9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:53.449435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:53.456241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 529/1061] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:53.457034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.463545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:53.468269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:53.541267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351760-a162-408b-89e9-8e6d97fcab7a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.563351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3b43-5417-4ef5-b3db-e01d0da2c2f6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.577208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.577810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.578303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.578411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.579076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:53.579293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:53.580640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:53.594194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 533/1062] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:53.595372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.600732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.601374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.601658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.601907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.602633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9, user.id=bf50696bef274a269ee6ff06570b6f02) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:53.602938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:53.604376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:53.616842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 530/1063] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/role_assignments?user.id=bf50696bef274a269ee6ff06570b6f02&scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:53.707468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:53.717653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f896-df8d-41d9-bac9-7d0635a3428c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.758805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.759451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.759717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.759985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.771595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:53.773092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:53.790328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:53.791325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:53.792239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:53.792239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:53.792239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:53.792239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 534/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:53.798915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:53.873455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:53.904522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24f7c-bac5-4b2a-a127-15c42249f8cb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:53.939044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:53.939710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:53.939963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:53.940148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:53.940829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:53.941169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:53.942758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:53.955254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 531/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:53.960874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.068283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39870ae0-6f10-46aa-a390-66c27b41f8c7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:54.104861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:54.113152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.113152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.113152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.118949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:54.120390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:54.131739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:54.132747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:54.139009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 535/1066] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:54.141088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.243977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370141bd-846d-45c9-a303-6d17f9f6a1fa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:54.274197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:54.280485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:54.281122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.281399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.281652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.282390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:54.282689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:54.284107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:54.301301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 532/1067] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:54.306734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.310629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:54.406079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d23e10-d8d3-4327-b72e-c208d923ae3f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:54.439135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731207c-0637-47da-8727-5aebe694caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:54.439765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731207c-0637-47da-8727-5aebe694caca None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.440039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731207c-0637-47da-8727-5aebe694caca None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.440300 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731207c-0637-47da-8727-5aebe694caca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.451117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731207c-0637-47da-8727-5aebe694caca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:54.452558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731207c-0637-47da-8727-5aebe694caca None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8731207c-0637-47da-8727-5aebe694caca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:54.467333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:54.468319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:54.469627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:54.469627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:54.469627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:54.473119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 536/1068] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:54.474342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.575408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fccded-0d73-46d5-a7de-94bf758fe6d3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:54.609887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:54.610494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.610743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.611036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.611672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:54.611945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:54.613418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:54.625133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 533/1069] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:54.630901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731207c-0637-47da-8727-5aebe694caca None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.696100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:54.746941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731207c-0637-47da-8727-5aebe694caca None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:54.781904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:54.782484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.782751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.783016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.789628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:54.791049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-d4e6be9f-289e-4b90-9cf0-ef08c74c1017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:54.802199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:54.803139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:54.804061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:54.807933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 537/1070] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:54.809286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.860489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:54.894813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3397c-31a0-4746-8f25-59e0ead6ffea None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.895140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3397c-31a0-4746-8f25-59e0ead6ffea None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.895366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3397c-31a0-4746-8f25-59e0ead6ffea None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.896958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 538/1071] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:54.901575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.901873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.902144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.913604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e1ea-63c5-4362-8a1e-d5f7b53539dd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:54.921823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:54.923370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:54.949062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:54.949654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:54.949927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:54.950205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:54.950899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:54.951252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:54.952601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:54.965160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 534/1072] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:54.970897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:54.996324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 539/1073] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:55.073783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b583f2-e596-4e01-9785-12586fb3623e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:55.084907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:55.110019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4afd3-c680-4fe7-9708-7308478f63fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:55.110746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4afd3-c680-4fe7-9708-7308478f63fa None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:55.110962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4afd3-c680-4fe7-9708-7308478f63fa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:55.111248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4afd3-c680-4fe7-9708-7308478f63fa None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/15d3488259a0490bb05a0c49688f5957/roles/39faf6e8871f4cf79239f8beca4e7603` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:55.113475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4afd3-c680-4fe7-9708-7308478f63fa None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=15d3488259a0490bb05a0c49688f5957, role_id=39faf6e8871f4cf79239f8beca4e7603)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:55.114931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4afd3-c680-4fe7-9708-7308478f63fa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:55.130048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 535/1074] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:54 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/15d3488259a0490bb05a0c49688f5957/roles/39faf6e8871f4cf79239f8beca4e7603 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:55.269355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:55.318185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:55.373101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb4418-2eef-418b-91e7-8102153856e1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:55.407393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:55.408014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:55.408301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:55.408573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:55.476826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:55.478271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:55.492036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fec5-7380-4ee8-9e36-0a5612b64e7c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:55.492319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fec5-7380-4ee8-9e36-0a5612b64e7c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:55.492597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fec5-7380-4ee8-9e36-0a5612b64e7c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:55.494120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 536/1075] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:55.498987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:55.499266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:55.499538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:55.521801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:55.523004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:55.529164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:55.591498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 540/1076] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:55.597049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:55.600844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 537/1077] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:55.709479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ae93b-8374-4a1a-81ca-f5a27a6d34f6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:55.745506 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:55.746205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:55.746471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:55.746787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:55.757533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:55.758959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:55.765790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:55.775122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:55.776080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:55.782187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:55.782187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:55.782187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:55.782187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 541/1078] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:55.783750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:55.857157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:55.885933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:55.888754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3c1c5-1ad1-4f4e-a136-0b797f2b3a34 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:55.925639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:55.926249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:55.926533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:55.926800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:55.927444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:55.927740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:55.929137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:55.940351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 538/1079] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:55.973558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561dab8-652f-40e8-b5a5-c55653c862e5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:56.012515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:56.013187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:56.013460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:56.013846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:56.027064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:56.031903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:56.032917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:56.037880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 542/1080] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:56.039744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:56.151620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc0752-7bc1-4203-bf1d-64df8db01a7a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:56.189324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:56.189969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:56.190248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:56.190519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:56.191261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:56.191559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:56.193026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:56.202818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 539/1081] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:56.209151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:56.270645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:56.313906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2724-f03a-4647-87f1-3b4400fe0b77 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:56.346050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:56.346673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:56.346951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:56.347220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] PATH_INFO: `/v3/users/bf50696bef274a269ee6ff06570b6f02` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:56.348365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] RBAC: Authorizing `identity:get_user(user_id=bf50696bef274a269ee6ff06570b6f02)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:56.349835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:56.351404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 543/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:54:56 2022] GET /identity/v3/users/bf50696bef274a269ee6ff06570b6f02 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:56.357360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:56.382246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:56.459048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541133-01e0-485e-b897-eee0290006bb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:56.498705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e9840-f46b-4b53-8498-e346381a4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:56.499348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9840-f46b-4b53-8498-e346381a4f0a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:56.499626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9840-f46b-4b53-8498-e346381a4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:56.499897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e9840-f46b-4b53-8498-e346381a4f0a None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:56.501115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9840-f46b-4b53-8498-e346381a4f0a None admin] RBAC: Authorizing `identity:get_project(project_id=f1feab2840c7439e9a7d97de53e8c8d9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:56.502877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e9840-f46b-4b53-8498-e346381a4f0a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:56.504628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 540/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:54:56 2022] GET /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:56.510786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:56.609500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096aa08-2a4d-47fd-af00-ef58a5954a3f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:56.634585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:56.644108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce0467-79f9-4187-93d1-7363b492478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:56.644767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0467-79f9-4187-93d1-7363b492478d None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:56.645071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0467-79f9-4187-93d1-7363b492478d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:56.645337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0467-79f9-4187-93d1-7363b492478d None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9/users/bf50696bef274a269ee6ff06570b6f02/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:56.647255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce0467-79f9-4187-93d1-7363b492478d None admin] RBAC: Authorizing `identity:create_grant(project_id=f1feab2840c7439e9a7d97de53e8c8d9, user_id=bf50696bef274a269ee6ff06570b6f02, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:56.648681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce0467-79f9-4187-93d1-7363b492478d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:56.661850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 544/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:54:56 2022] PUT /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9/users/bf50696bef274a269ee6ff06570b6f02/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:54:57.002920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4ecc-a192-4c7d-ad2f-739eedfb4a31 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:57.003145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4ecc-a192-4c7d-ad2f-739eedfb4a31 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:57.003392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4ecc-a192-4c7d-ad2f-739eedfb4a31 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:57.004727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 541/1085] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:54:57.009927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314a98-e572-456a-9074-816d56f461aa None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:57.010217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314a98-e572-456a-9074-816d56f461aa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:57.010491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314a98-e572-456a-9074-816d56f461aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:57.029916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9b314a98-e572-456a-9074-816d56f461aa None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:57.031096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b314a98-e572-456a-9074-816d56f461aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:57.102333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 545/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:54:57.366950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4ecc-a192-4c7d-ad2f-739eedfb4a31 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:57.460547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:57.472615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4ecc-a192-4c7d-ad2f-739eedfb4a31 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:57.508211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:57.508831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:57.509133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:57.509401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:57.520358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:57.525182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:57.526153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 03:54:57.527007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:57.531199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 542/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Aug 31 03:54:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:57.532411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314a98-e572-456a-9074-816d56f461aa None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:57.633062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314a98-e572-456a-9074-816d56f461aa None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:57.649614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:57.667791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:57.668399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:57.668673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:57.668964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:57.669622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:57.669909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:57.671257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:57.679217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 546/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:54:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:57.684825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:57.787762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd227e-ada4-4687-abf1-531b382b4a9e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:57.822684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:57.823303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:57.823574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:57.823839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:57.834281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:57.835716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:57.849582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:57.850522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:57.851540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:57.851540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:57.851540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:57.851540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 543/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:57.856589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:57.956753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9fb3-660e-42ea-9094-a368410b3db2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:57.990693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:57.991292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:57.991562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:57.991829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:57.992461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:57.992761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:57.994142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:58.006215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 547/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:58.011946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.015098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:58.111564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6788dd-c8c6-4a1a-bdee-c06089ed1c1a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:58.144986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:58.145610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.145884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.146152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.153826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:58.155263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:54:58.166552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:58.167531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:58.168481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 544/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:58.173553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.217342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:58.279214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4499dcb-58c4-4561-9922-84a8d72cb3cf None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:58.314031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:58.314636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.314913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.315178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.315960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:58.316247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:58.317703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58a270-0b2c-49b3-b484-422afc667c2b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:58.334596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 548/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:58.340512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.406655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:58.446141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb64b-6534-422a-a645-85cb178380c3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:58.480434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:58.480996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.481267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.481530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.508492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddc396-e4b6-4581-b062-9b08ce346f5a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.508734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddc396-e4b6-4581-b062-9b08ce346f5a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.509064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddc396-e4b6-4581-b062-9b08ce346f5a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.510414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 549/1093] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:54:58.515433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.515808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.515947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.534999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:54:58.536198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:54:58.555186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:58.556650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:58.602949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 550/1094] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:54:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:54:58.615255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:58.654348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 545/1095] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:54:58.660146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.687628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:58.760358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fdce5-651a-46fa-a785-8662923c97b4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:58.801067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:58.801694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.801964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.802229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.813033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:58.814481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:54:58.829084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:58.830080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:54:58.831004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:54:58.831004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:54:58.831004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:58.833236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 551/1096] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:58.835929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.864932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.938281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb4288-59ee-49cd-9675-85f02f12bfb4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:58.943091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:58.965469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8033b5-e78b-423d-8252-ba4d18e951d6 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:58.972435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:58.973073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.973351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:58.973621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:58.974261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:58.974560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:58.975931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:58.987275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 546/1097] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:58.992974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:58.998937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:58.999562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:58.999835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.000108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.010707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:54:59.015915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:59.017470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:54:59.018541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 552/1098] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:54:59.021701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:59.023161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.096906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee0d8-aaf9-4277-9c0c-57163c100f60 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.121851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d37f-f1ec-46d0-9056-0c309edd15c8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.130470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.131103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.131379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.131648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.138131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.139556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:54:59.150916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:54:59.151956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:54:59.152927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:54:59.155039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.155643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.155915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.156179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.156986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:59.157107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 547/1099] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:54:59.157197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.157935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.158489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.163870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:59.173389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 553/1100] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:59.179825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.244370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:59.263673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543aedb-83ba-4634-b78b-1a4fd0d6f36e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.280135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a642f-250d-4552-9c25-9ecff54800c1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.297732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.298341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.298615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.298881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.299569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:59.299874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.301386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.313745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 548/1101] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:59.314469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.315091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.315362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.315633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] PATH_INFO: `/v3/users/bf50696bef274a269ee6ff06570b6f02` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.316776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] RBAC: Authorizing `identity:get_user(user_id=bf50696bef274a269ee6ff06570b6f02)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.318219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.319760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.319903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 554/1102] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/users/bf50696bef274a269ee6ff06570b6f02 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:59.325316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.390301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:59.418002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9afe68-2fca-49d1-95ff-40d998151f0d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.426217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cf605-f1fe-4c88-a35b-66121d79c4bc None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.451451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.452056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.452331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.452601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.453353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] RBAC: Adding query filter params (role.id=39faf6e8871f4cf79239f8beca4e7603, scope.project.id=7514901da21f40398a0143744fd11757, user.id=15d3488259a0490bb05a0c49688f5957) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:59.453658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.455086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.459138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.459736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.460010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.460275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.460681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 549/1103] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/role_assignments?user.id=15d3488259a0490bb05a0c49688f5957&scope.project.id=7514901da21f40398a0143744fd11757&role.id=39faf6e8871f4cf79239f8beca4e7603 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:54:59.544556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.545964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.613371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:59.649493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 555/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 03:54:59.655576 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.664855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:54:59.762829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80cd2-6940-4c0a-8382-05155d15cb1b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.802080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596a19-a710-4481-b914-3099738d4bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.802650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596a19-a710-4481-b914-3099738d4bab None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.802929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596a19-a710-4481-b914-3099738d4bab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.803227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596a19-a710-4481-b914-3099738d4bab None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.806157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee596a19-a710-4481-b914-3099738d4bab None admin] RBAC: Authorizing `identity:get_project(project_id=f1feab2840c7439e9a7d97de53e8c8d9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.807613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee596a19-a710-4481-b914-3099738d4bab None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.809274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 550/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:54:59.815554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:54:59.918292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcb6a8-0995-414b-9686-d746ec87b0eb None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:54:59.952130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:54:59.952736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:54:59.953070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:54:59.953335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:54:59.954052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9, user.id=bf50696bef274a269ee6ff06570b6f02) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:54:59.954354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:54:59.955771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b3cae-082c-46dd-a6e1-16fd6e60c23d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:54:59.961907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 556/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:54:59 2022] GET /identity/v3/role_assignments?user.id=bf50696bef274a269ee6ff06570b6f02&scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:01.862273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9af6-8def-4d2e-8928-6b67590dbbe8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:01.862871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9af6-8def-4d2e-8928-6b67590dbbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:01.862871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9af6-8def-4d2e-8928-6b67590dbbe8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:01.864321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 551/1107] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:01.869565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:01.869973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:01.870113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:01.891058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:01.892387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:01.921882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:01.969044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 557/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:02.229936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9af6-8def-4d2e-8928-6b67590dbbe8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:02.313176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:02.340422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9af6-8def-4d2e-8928-6b67590dbbe8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:02.374997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325f047-f806-46c3-bd32-b1d358cf59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:02.375620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f047-f806-46c3-bd32-b1d358cf59c7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:02.375896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f047-f806-46c3-bd32-b1d358cf59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:02.376164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f047-f806-46c3-bd32-b1d358cf59c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:02.377745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f047-f806-46c3-bd32-b1d358cf59c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:02.379206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f047-f806-46c3-bd32-b1d358cf59c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:02.380743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 552/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:55:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:02.386926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:02.490392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f213e4-3cb4-4637-abc6-795bcdd7d64f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:02.525748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeec54-d2e4-4877-8e90-22f1a54d76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:02.526343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeec54-d2e4-4877-8e90-22f1a54d76a8 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:02.526619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeec54-d2e4-4877-8e90-22f1a54d76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:02.526886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeec54-d2e4-4877-8e90-22f1a54d76a8 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:02.527537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeec54-d2e4-4877-8e90-22f1a54d76a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:02.529018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeec54-d2e4-4877-8e90-22f1a54d76a8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:02.557065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 558/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:55:02 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:55:04.439182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a369f7-6dfb-4728-ae8f-d61e2ef71334 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:04.440025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a369f7-6dfb-4728-ae8f-d61e2ef71334 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:04.440025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a369f7-6dfb-4728-ae8f-d61e2ef71334 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:04.442362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 553/1111] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:04.447699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:04.448131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:04.448231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:04.468739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:04.469988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:04.485191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:04.553447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 559/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:04.815003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a369f7-6dfb-4728-ae8f-d61e2ef71334 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:04.938854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a369f7-6dfb-4728-ae8f-d61e2ef71334 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:04.980608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:04.981191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:04.981463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:04.981733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] PATH_INFO: `/v3/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:04.983299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] RBAC: Authorizing `identity:get_role(role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:04.984662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:04.985986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 554/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:04 2022] GET /identity/v3/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:04.992550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:05.103523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d23d18-5352-4ef9-b911-3aa1d44de3c4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:05.139361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:05.139982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:05.140261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:05.140525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] PATH_INFO: `/v3/users/1b2857295af24cb998a50ce310dfdd59` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:05.153961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] RBAC: Authorizing `identity:get_user(user_id=1b2857295af24cb998a50ce310dfdd59)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:05.155408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:05.157029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 560/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:04 2022] GET /identity/v3/users/1b2857295af24cb998a50ce310dfdd59 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:05.163745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:05.181255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:05.277149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e7a97-504d-47e0-909e-86aeb0c781ca None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:05.312737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:05.313354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:05.313630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:05.313897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:05.382259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:05.383686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:05.395388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:05.493523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 555/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:05.500512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:05.510806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:05.603213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb294ef6-868b-48f2-aad4-6c1d05de436a None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:05.644670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3455e61-2356-4bad-8075-338418409808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:05.645557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3455e61-2356-4bad-8075-338418409808 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:05.645888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3455e61-2356-4bad-8075-338418409808 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:05.646246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3455e61-2356-4bad-8075-338418409808 None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:05.648198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3455e61-2356-4bad-8075-338418409808 None admin] RBAC: Authorizing `identity:get_project(project_id=f1feab2840c7439e9a7d97de53e8c8d9)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:05.650484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3455e61-2356-4bad-8075-338418409808 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:05.653032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 561/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:05 2022] GET /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:05.659667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:05.762993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c651dd6-0cb2-4e70-8413-16a3e81550dc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:05.774750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:05.800126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:05.800719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:05.801031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:05.801303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:05.802027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] RBAC: Adding query filter params (role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9, user.id=1b2857295af24cb998a50ce310dfdd59) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:05.802331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:05.803758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b796-355f-4ecb-b113-bcde94352ab4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:05.809199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 556/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:55:05 2022] GET /identity/v3/role_assignments?user.id=1b2857295af24cb998a50ce310dfdd59&scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:07.640276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b16aa-04bc-4cc3-ad45-ac3106b860ec None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:07.640883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b16aa-04bc-4cc3-ad45-ac3106b860ec None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:07.640883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b16aa-04bc-4cc3-ad45-ac3106b860ec None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:07.642183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 562/1118] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:07.647640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38793-674d-4b24-b12d-21419898f34f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:07.648063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38793-674d-4b24-b12d-21419898f34f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:07.648153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38793-674d-4b24-b12d-21419898f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:07.666909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-21a38793-674d-4b24-b12d-21419898f34f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:07.668081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21a38793-674d-4b24-b12d-21419898f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:07.741826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 557/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:08.011821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b16aa-04bc-4cc3-ad45-ac3106b860ec None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:08.101626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:08.129768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b16aa-04bc-4cc3-ad45-ac3106b860ec None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:08.164504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:08.165147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:08.165448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:08.165716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] PATH_INFO: `/v3/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:08.167731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] RBAC: Authorizing `identity:get_role(role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:08.169730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:08.171986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 563/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:08 2022] GET /identity/v3/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:08.178976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38793-674d-4b24-b12d-21419898f34f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:08.290037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38793-674d-4b24-b12d-21419898f34f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:08.292284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:08.330238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:08.330874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:08.331189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:08.331458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] PATH_INFO: `/v3/users/1b2857295af24cb998a50ce310dfdd59` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:08.332589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2857295af24cb998a50ce310dfdd59)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:08.334062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:08.335599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 558/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:08 2022] GET /identity/v3/users/1b2857295af24cb998a50ce310dfdd59 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:08.341785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:08.454217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695ba55-c0a2-4b64-8798-728fd485f198 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:08.492220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdec99-7c87-4cce-aeec-5e21da6a3e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:08.492848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdec99-7c87-4cce-aeec-5e21da6a3e2d None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:08.493137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdec99-7c87-4cce-aeec-5e21da6a3e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:08.493435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdec99-7c87-4cce-aeec-5e21da6a3e2d None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:08.494667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdec99-7c87-4cce-aeec-5e21da6a3e2d None admin] RBAC: Authorizing `identity:get_project(project_id=f1feab2840c7439e9a7d97de53e8c8d9)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:08.496120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdec99-7c87-4cce-aeec-5e21da6a3e2d None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:08.497781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 564/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:08 2022] GET /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:08.504328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:08.608766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079338b-c571-4f0e-8e68-0505524a0a19 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:08.646044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff7b1-008b-4e29-b029-d6043d93f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:08.646734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff7b1-008b-4e29-b029-d6043d93f6ea None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:08.647004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff7b1-008b-4e29-b029-d6043d93f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:08.647272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff7b1-008b-4e29-b029-d6043d93f6ea None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9/users/1b2857295af24cb998a50ce310dfdd59/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:08.649820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff7b1-008b-4e29-b029-d6043d93f6ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f1feab2840c7439e9a7d97de53e8c8d9, user_id=1b2857295af24cb998a50ce310dfdd59, role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:08.651242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff7b1-008b-4e29-b029-d6043d93f6ea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:08.667103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 559/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:55:08 2022] PUT /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9/users/1b2857295af24cb998a50ce310dfdd59/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:55:10.514672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede7de1-e7aa-4440-9f68-acc1fc413f73 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:10.515270 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede7de1-e7aa-4440-9f68-acc1fc413f73 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:10.515270 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede7de1-e7aa-4440-9f68-acc1fc413f73 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:10.516538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 565/1124] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:10.522879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:10.523628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:10.523760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:10.552559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:10.553766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:10.581031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:10.623505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 560/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:10.886478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede7de1-e7aa-4440-9f68-acc1fc413f73 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:10.900762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:11.009208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede7de1-e7aa-4440-9f68-acc1fc413f73 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:11.049898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:11.050781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:11.051139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:11.051479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] PATH_INFO: `/v3/roles/45e364e8eaff47a49fd4c58155f2ad7e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:11.054202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] RBAC: Authorizing `identity:get_role(role_id=45e364e8eaff47a49fd4c58155f2ad7e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:11.056358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:11.058475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 566/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:10 2022] GET /identity/v3/roles/45e364e8eaff47a49fd4c58155f2ad7e => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:11.064668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:11.165724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1bd53-0247-49c2-a67d-d557228abd9c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:11.200183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:11.200795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:11.201095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:11.201358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] PATH_INFO: `/v3/users/1b2857295af24cb998a50ce310dfdd59` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:11.202587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] RBAC: Authorizing `identity:get_user(user_id=1b2857295af24cb998a50ce310dfdd59)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:11.204006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:11.205589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 561/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:11 2022] GET /identity/v3/users/1b2857295af24cb998a50ce310dfdd59 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:11.211962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:11.313004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:11.336791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744818bd-cb09-42e1-9507-756fa01201d5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:11.371986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:11.372584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:11.372866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:11.373153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:11.449155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:11.450527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:11.534677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:11.557911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 567/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:11.564591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:11.597898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:11.685723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae33b-359a-425a-827f-a7f13530566d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:11.724283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a9485-c68c-4ea5-b4e6-18a98eeda980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:11.724836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a9485-c68c-4ea5-b4e6-18a98eeda980 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:11.725143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a9485-c68c-4ea5-b4e6-18a98eeda980 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:11.725409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a9485-c68c-4ea5-b4e6-18a98eeda980 None admin] PATH_INFO: `/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:11.726582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a9485-c68c-4ea5-b4e6-18a98eeda980 None admin] RBAC: Authorizing `identity:get_project(project_id=f1feab2840c7439e9a7d97de53e8c8d9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:11.728038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a9485-c68c-4ea5-b4e6-18a98eeda980 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:11.729706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 562/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:11 2022] GET /identity/v3/projects/f1feab2840c7439e9a7d97de53e8c8d9 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:11.736230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:11.838513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6bde1-1726-4f22-b233-7dbb26456095 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:11.874012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:11.874594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:11.874865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:11.875129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:11.875850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] RBAC: Adding query filter params (role.id=45e364e8eaff47a49fd4c58155f2ad7e, scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9, user.id=1b2857295af24cb998a50ce310dfdd59) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:11.876142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:11.877932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb191f2-7632-439e-ac75-142ca296e596 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:11.884290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 568/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:55:11 2022] GET /identity/v3/role_assignments?user.id=1b2857295af24cb998a50ce310dfdd59&scope.project.id=f1feab2840c7439e9a7d97de53e8c8d9&role.id=45e364e8eaff47a49fd4c58155f2ad7e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:13.781907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ad8b-944c-4cc5-a87e-d9e6d3c28e1d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:13.782462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ad8b-944c-4cc5-a87e-d9e6d3c28e1d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:13.782462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5ad8b-944c-4cc5-a87e-d9e6d3c28e1d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:13.783816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 563/1131] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:13.790275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:13.790998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:13.791149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:13.820140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:13.821370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:13.857851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:13.899462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 569/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:14.169212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5ad8b-944c-4cc5-a87e-d9e6d3c28e1d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:14.292678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:14.300743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5ad8b-944c-4cc5-a87e-d9e6d3c28e1d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:14.337119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49aa89-63d3-4f76-b098-73cb82b73ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:14.337750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49aa89-63d3-4f76-b098-73cb82b73ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:14.338021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49aa89-63d3-4f76-b098-73cb82b73ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:14.338290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49aa89-63d3-4f76-b098-73cb82b73ca3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:14.339544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49aa89-63d3-4f76-b098-73cb82b73ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:14.341020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49aa89-63d3-4f76-b098-73cb82b73ca3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:14.342590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 564/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:55:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:14.348905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:14.462373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f35841-3ab3-4fa3-80d0-aee009b99c3d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:14.497723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cca99e-8df9-4e9b-ac9b-fa1839d26741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:14.498327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cca99e-8df9-4e9b-ac9b-fa1839d26741 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:14.498604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cca99e-8df9-4e9b-ac9b-fa1839d26741 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:14.498873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cca99e-8df9-4e9b-ac9b-fa1839d26741 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:14.499524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cca99e-8df9-4e9b-ac9b-fa1839d26741 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:14.500984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cca99e-8df9-4e9b-ac9b-fa1839d26741 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:14.530495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 570/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:55:14 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:55:16.448275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8b77f-b1ef-484b-8b11-b8c93c870a99 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:16.449239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8b77f-b1ef-484b-8b11-b8c93c870a99 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:16.449239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8b77f-b1ef-484b-8b11-b8c93c870a99 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:16.451242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 565/1135] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:16.459353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:16.459756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:16.459946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:16.493899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:16.495094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:16.515287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:16.569444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 571/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:16.840358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8b77f-b1ef-484b-8b11-b8c93c870a99 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:16.958808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8b77f-b1ef-484b-8b11-b8c93c870a99 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:16.994601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1fcb-60be-46e3-bad2-ec54726bd95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:16.995229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1fcb-60be-46e3-bad2-ec54726bd95b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:16.995501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1fcb-60be-46e3-bad2-ec54726bd95b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:16.995776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1fcb-60be-46e3-bad2-ec54726bd95b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:16.997045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1fcb-60be-46e3-bad2-ec54726bd95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:16.998501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1fcb-60be-46e3-bad2-ec54726bd95b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:17.000086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 566/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:55:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:17.007137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:17.121955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aec9fe-fc1d-45e3-9bd5-5874baafc85c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:17.167113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2813c-c1c6-4c41-b54e-bba30d131164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:17.167708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2813c-c1c6-4c41-b54e-bba30d131164 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:17.167979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2813c-c1c6-4c41-b54e-bba30d131164 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:17.168244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2813c-c1c6-4c41-b54e-bba30d131164 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:17.168908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2813c-c1c6-4c41-b54e-bba30d131164 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:17.170325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2813c-c1c6-4c41-b54e-bba30d131164 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:17.193883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 572/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:55:17 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:55:19.088644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532682-c0dd-48e8-92c4-5aa94c82b736 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:19.089253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532682-c0dd-48e8-92c4-5aa94c82b736 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:19.089253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532682-c0dd-48e8-92c4-5aa94c82b736 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:19.090566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 567/1139] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:19.096867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:19.097312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:19.097403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:19.119099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:19.120709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:19.123686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:19.197075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 573/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:19.470955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532682-c0dd-48e8-92c4-5aa94c82b736 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:19.512668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:19.583555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532682-c0dd-48e8-92c4-5aa94c82b736 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:19.634939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:19.635560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:19.635840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:19.636109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:19.646935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:55:19.651724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:19.652950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:55:19.654070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 568/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:19.659102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:19.763469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609872e5-2016-4077-a4a4-f06b7fd8633a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:19.799569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:19.800173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:19.800446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:19.800712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:19.801414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:19.801718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:19.803087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:19.811343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 574/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:19.817617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:19.917355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:19.924698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dbce4-df4f-4e35-bfc3-900e3d16b97f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:19.961631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:19.962253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:19.962523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:19.962787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] PATH_INFO: `/v3/users/bc1dbfd7a096484c87815faed557c0eb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:19.981180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] RBAC: Authorizing `identity:get_user(user_id=bc1dbfd7a096484c87815faed557c0eb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:19.983493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:19.985980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 569/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:19 2022] GET /identity/v3/users/bc1dbfd7a096484c87815faed557c0eb => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:19.996773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:20.000877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:20.106836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5e6b6-1272-4120-97f8-a5f184c7a36e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:20.142051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:20.142641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:20.142913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:20.143179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:20.210949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:20.212372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:20.214209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:20.323040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 575/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:20.329352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:20.438070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61457a0d-065a-4b51-acaf-7b7134f10970 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:20.472995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f48d4c-7fff-4fdb-a6a5-d79fcb715704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:20.473616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48d4c-7fff-4fdb-a6a5-d79fcb715704 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:20.473890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48d4c-7fff-4fdb-a6a5-d79fcb715704 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:20.474152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f48d4c-7fff-4fdb-a6a5-d79fcb715704 None admin] PATH_INFO: `/v3/projects/83dc6b44fcb24da280f644518789f0dd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:20.475390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48d4c-7fff-4fdb-a6a5-d79fcb715704 None admin] RBAC: Authorizing `identity:get_project(project_id=83dc6b44fcb24da280f644518789f0dd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:20.476847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f48d4c-7fff-4fdb-a6a5-d79fcb715704 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:20.478433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 570/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:20 2022] GET /identity/v3/projects/83dc6b44fcb24da280f644518789f0dd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:20.485331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:20.587350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459a58-e247-47af-801a-6b928ca287e8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:20.588926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:20.626057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:20.626645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:20.627241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:20.627511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:20.628297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=83dc6b44fcb24da280f644518789f0dd, user.id=bc1dbfd7a096484c87815faed557c0eb) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:20.628597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:20.630047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58792dd2-71dd-434d-9aa4-2475ec55b513 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:20.635518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 576/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:55:20 2022] GET /identity/v3/role_assignments?user.id=bc1dbfd7a096484c87815faed557c0eb&scope.project.id=83dc6b44fcb24da280f644518789f0dd&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:22.487409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc60df7-ce40-41ec-80ec-6c81b3657716 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:22.488290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc60df7-ce40-41ec-80ec-6c81b3657716 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:22.488290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc60df7-ce40-41ec-80ec-6c81b3657716 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:22.490424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 571/1147] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:22.496639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:22.497402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:22.497527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:22.524955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:22.526136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:22.596381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 577/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:22.861867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc60df7-ce40-41ec-80ec-6c81b3657716 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:22.891735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:22.974864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc60df7-ce40-41ec-80ec-6c81b3657716 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:23.012412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:23.013052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:23.013328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:23.013601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:23.024726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:55:23.029485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:23.030637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:55:23.031893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 572/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:55:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:23.036969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:23.146564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:23.153608 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f9e86-623a-44e3-8098-7534b7061522 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:23.194625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:23.195568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:23.196011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:23.196425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:23.197583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:23.198078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:23.200278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:23.211049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 578/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:55:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:23.217058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:23.307422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:23.327596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8cd86-ecdb-4a54-a749-c0d2be6e29ff None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:23.362840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:23.363461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:23.363734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:23.364001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] PATH_INFO: `/v3/users/bc1dbfd7a096484c87815faed557c0eb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:23.365256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] RBAC: Authorizing `identity:get_user(user_id=bc1dbfd7a096484c87815faed557c0eb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:23.366694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:23.368256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 573/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:23 2022] GET /identity/v3/users/bc1dbfd7a096484c87815faed557c0eb => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:23.375032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:23.483602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee293-5fcc-4d48-b285-35512618ef90 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:23.518751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a25db1-b4f6-4167-a8df-614e01d45aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:23.519388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a25db1-b4f6-4167-a8df-614e01d45aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:23.519696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a25db1-b4f6-4167-a8df-614e01d45aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:23.519968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a25db1-b4f6-4167-a8df-614e01d45aa0 None admin] PATH_INFO: `/v3/projects/83dc6b44fcb24da280f644518789f0dd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:23.521258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a25db1-b4f6-4167-a8df-614e01d45aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=83dc6b44fcb24da280f644518789f0dd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:23.522679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a25db1-b4f6-4167-a8df-614e01d45aa0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:23.524301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 579/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:23 2022] GET /identity/v3/projects/83dc6b44fcb24da280f644518789f0dd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:23.530412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:23.637941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491dba0-5991-4781-9dfd-3560ff0efb81 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:23.673129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5544a7-4b7d-408e-902d-d6d76a6b216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:23.673780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5544a7-4b7d-408e-902d-d6d76a6b216e None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:23.674053 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5544a7-4b7d-408e-902d-d6d76a6b216e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:23.674320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5544a7-4b7d-408e-902d-d6d76a6b216e None admin] PATH_INFO: `/v3/projects/83dc6b44fcb24da280f644518789f0dd/users/bc1dbfd7a096484c87815faed557c0eb/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:23.676457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5544a7-4b7d-408e-902d-d6d76a6b216e None admin] RBAC: Authorizing `identity:create_grant(project_id=83dc6b44fcb24da280f644518789f0dd, user_id=bc1dbfd7a096484c87815faed557c0eb, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:23.677913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5544a7-4b7d-408e-902d-d6d76a6b216e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:23.693556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 574/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:55:23 2022] PUT /identity/v3/projects/83dc6b44fcb24da280f644518789f0dd/users/bc1dbfd7a096484c87815faed557c0eb/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:55:25.535397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c2a92-d758-4d08-b727-9381d7ce7af1 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:25.536282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c2a92-d758-4d08-b727-9381d7ce7af1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:25.536282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c2a92-d758-4d08-b727-9381d7ce7af1 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:25.538498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 580/1154] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:25.544680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:25.545492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:25.545649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:25.567855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:25.569072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:25.571150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:25.645346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 575/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:25.907337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c2a92-d758-4d08-b727-9381d7ce7af1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:25.950040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:26.036020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c2a92-d758-4d08-b727-9381d7ce7af1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:26.076061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:26.076698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:26.077006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:26.077297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:26.088752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:55:26.093623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:26.094610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:55:26.095795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 581/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:26.101678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:26.203660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05dfb-4cef-40e1-94c4-89741c7af7fe None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:26.241561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:26.242155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:26.242431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:26.242697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:26.243388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:26.243695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:26.245111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:26.250068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:26.254018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 576/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:26.259841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:26.347020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:26.363096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec39f4-0b1f-4a99-8dbb-d5c14e9c87e4 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:26.398542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:26.399162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:26.399438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:26.399709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] PATH_INFO: `/v3/users/bc1dbfd7a096484c87815faed557c0eb` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:26.400970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] RBAC: Authorizing `identity:get_user(user_id=bc1dbfd7a096484c87815faed557c0eb)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:26.402402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:26.403970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 582/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:26 2022] GET /identity/v3/users/bc1dbfd7a096484c87815faed557c0eb => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:26.410113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:26.520640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edbaba-f2d7-415f-8840-b2b55ba81b10 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:26.555616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:26.556188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:26.556464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:26.556727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:26.622830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:26.625448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:26.627340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:26.727307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 577/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:26.733367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:26.832399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c86a-56ee-4aea-b3e6-017c776e55a1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:26.867471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5c9fc-64d3-4741-8173-48a5aa0d01b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:26.868078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c9fc-64d3-4741-8173-48a5aa0d01b1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:26.868351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c9fc-64d3-4741-8173-48a5aa0d01b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:26.868618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5c9fc-64d3-4741-8173-48a5aa0d01b1 None admin] PATH_INFO: `/v3/projects/83dc6b44fcb24da280f644518789f0dd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:26.869867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c9fc-64d3-4741-8173-48a5aa0d01b1 None admin] RBAC: Authorizing `identity:get_project(project_id=83dc6b44fcb24da280f644518789f0dd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:26.871280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5c9fc-64d3-4741-8173-48a5aa0d01b1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:26.872894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 583/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:26 2022] GET /identity/v3/projects/83dc6b44fcb24da280f644518789f0dd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:26.879388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:26.979607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:26.982807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5ffb-370b-475f-a934-28ad0794a87a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:27.022445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:27.023035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:27.023307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:27.023571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:27.024291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=83dc6b44fcb24da280f644518789f0dd, user.id=bc1dbfd7a096484c87815faed557c0eb) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:27.024593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:27.026049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31076d-64d0-49a5-86ca-9554876ebb91 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:27.031828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 578/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:55:26 2022] GET /identity/v3/role_assignments?user.id=bc1dbfd7a096484c87815faed557c0eb&scope.project.id=83dc6b44fcb24da280f644518789f0dd&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:28.909692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884554-1d20-4478-9f58-f15a7950b9c3 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:28.910516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884554-1d20-4478-9f58-f15a7950b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:28.910516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884554-1d20-4478-9f58-f15a7950b9c3 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:28.912686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 584/1162] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:28.918929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:28.919663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:28.919793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:28.946352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:28.947470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:29.017565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 579/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:29.283304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884554-1d20-4478-9f58-f15a7950b9c3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:29.310727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:29.410462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884554-1d20-4478-9f58-f15a7950b9c3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:29.453362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:29.453982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:29.454255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:29.454529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:29.524381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:29.525855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:29.548855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:29.627284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 585/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:29.636172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:29.742931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:29.750294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9884f2c-4683-4dfe-a4a8-22a5a237ac42 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:29.785386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:29.786016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:29.786297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:29.786566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:29.793528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:29.794994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d9f8506c-3aec-4caa-a865-5a46a1fa7703 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:29.815001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:29.816163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:55:29.817077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 580/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:55:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:29.823850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:29.927903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60504e8f-5e59-4c25-b27c-31ff82ef5f8b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:29.950492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:29.963107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:29.963704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:29.963980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:29.964251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:29.964911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:29.965210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:29.966569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94df13-15aa-4e8f-92a3-d5831188aece None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:29.973871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 586/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Aug 31 03:55:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:31.856751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81166-f032-477e-b384-55e1733bf73d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:31.857636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81166-f032-477e-b384-55e1733bf73d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:31.857636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81166-f032-477e-b384-55e1733bf73d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:31.859814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 581/1167] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:31.866035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52f7a-5679-4da8-b8a7-06ca37d48b20 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:31.866793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52f7a-5679-4da8-b8a7-06ca37d48b20 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:31.866922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d52f7a-5679-4da8-b8a7-06ca37d48b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:31.890574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a1d52f7a-5679-4da8-b8a7-06ca37d48b20 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:31.891760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a1d52f7a-5679-4da8-b8a7-06ca37d48b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:31.974222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 587/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:32.245076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81166-f032-477e-b384-55e1733bf73d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:32.375599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81166-f032-477e-b384-55e1733bf73d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:32.416476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2794dc7-2539-4990-bae2-34190bf054c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:32.417112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2794dc7-2539-4990-bae2-34190bf054c7 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:32.417387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2794dc7-2539-4990-bae2-34190bf054c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:32.417662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2794dc7-2539-4990-bae2-34190bf054c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:32.418328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2794dc7-2539-4990-bae2-34190bf054c7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:32.419708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2794dc7-2539-4990-bae2-34190bf054c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:32.439411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 582/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Wed Aug 31 03:55:32 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:55:34.324387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbd1dd-62c0-435b-84b0-c723d617ee62 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:34.325303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbd1dd-62c0-435b-84b0-c723d617ee62 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:34.325303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbd1dd-62c0-435b-84b0-c723d617ee62 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:34.327424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 588/1170] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:34.336161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:34.336566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:34.336709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:34.359537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:34.360737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:34.370312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:34.435681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 583/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:34.696532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbd1dd-62c0-435b-84b0-c723d617ee62 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:34.815119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbd1dd-62c0-435b-84b0-c723d617ee62 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:34.832588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:34.851779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125ff0-c075-4dbd-bc11-bb57aee34e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:34.852408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125ff0-c075-4dbd-bc11-bb57aee34e9b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:34.852680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125ff0-c075-4dbd-bc11-bb57aee34e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:34.852982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125ff0-c075-4dbd-bc11-bb57aee34e9b None admin] PATH_INFO: `/v3/domains/851f5671904b4e68be584f739a17d2f0` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:34.863603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9125ff0-c075-4dbd-bc11-bb57aee34e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=851f5671904b4e68be584f739a17d2f0)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:34.865080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9125ff0-c075-4dbd-bc11-bb57aee34e9b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:34.866658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 589/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Aug 31 03:55:34 2022] GET /identity/v3/domains/851f5671904b4e68be584f739a17d2f0 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:34.872834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:34.974930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f48b1-0225-4a73-97eb-41b9cdb344a1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:35.014305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8768fc-e385-4faa-8de7-5fba69d6b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:35.014905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8768fc-e385-4faa-8de7-5fba69d6b48e None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:35.015176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8768fc-e385-4faa-8de7-5fba69d6b48e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:35.015442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8768fc-e385-4faa-8de7-5fba69d6b48e None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:35.016090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8768fc-e385-4faa-8de7-5fba69d6b48e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:35.017551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8768fc-e385-4faa-8de7-5fba69d6b48e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:35.033601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:35.048431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 584/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:55:34 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:55:36.949994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dda94-1fac-4a75-a82c-6aafcf7680e0 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:36.950874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dda94-1fac-4a75-a82c-6aafcf7680e0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:36.950874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dda94-1fac-4a75-a82c-6aafcf7680e0 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:36.952997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 590/1174] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:36.961570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:36.961980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:36.962130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:36.990549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:36.991714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:37.070253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 585/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:37.334195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dda94-1fac-4a75-a82c-6aafcf7680e0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:37.449735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dda94-1fac-4a75-a82c-6aafcf7680e0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:37.489461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff7d70-f9d9-4a41-bac2-3a4255fb23e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:37.490090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff7d70-f9d9-4a41-bac2-3a4255fb23e0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:37.490360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff7d70-f9d9-4a41-bac2-3a4255fb23e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:37.490622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff7d70-f9d9-4a41-bac2-3a4255fb23e0 None admin] PATH_INFO: `/v3/domains/851f5671904b4e68be584f739a17d2f0` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:37.491955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff7d70-f9d9-4a41-bac2-3a4255fb23e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=851f5671904b4e68be584f739a17d2f0)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:37.493436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff7d70-f9d9-4a41-bac2-3a4255fb23e0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:37.494999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 591/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Aug 31 03:55:37 2022] GET /identity/v3/domains/851f5671904b4e68be584f739a17d2f0 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:37.501063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:37.603979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90432a-bb74-403c-8f5a-f01ff4c58421 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:37.642672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:37.652619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254598c-f935-4663-93a3-dee42d6cf114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:37.653254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254598c-f935-4663-93a3-dee42d6cf114 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:37.653530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254598c-f935-4663-93a3-dee42d6cf114 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:37.653800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254598c-f935-4663-93a3-dee42d6cf114 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:37.654444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254598c-f935-4663-93a3-dee42d6cf114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:37.655868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254598c-f935-4663-93a3-dee42d6cf114 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:37.679482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 586/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:55:37 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:55:39.591658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e7a7e-92c0-4b38-ad5e-69d696cd86af None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:39.592693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e7a7e-92c0-4b38-ad5e-69d696cd86af None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:39.592693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e7a7e-92c0-4b38-ad5e-69d696cd86af None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:39.594954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 592/1178] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:39.601553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:39.602025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:39.602140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:39.624452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:39.625665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:39.694951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 587/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:39.960865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e7a7e-92c0-4b38-ad5e-69d696cd86af None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:40.019623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:40.077571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e7a7e-92c0-4b38-ad5e-69d696cd86af None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:40.113913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:40.114571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:40.114850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:40.115128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:40.127782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:55:40.132574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:40.133829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:55:40.136104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 593/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:40.143809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:40.255475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1809c1-f3ca-4025-aaec-d726570a861c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:40.268844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:40.292423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:40.293063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:40.293343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:40.293614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:40.294282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:40.294566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:40.295960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:40.304376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 588/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:40.310313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:40.417357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46303034-d8cf-4fbd-b9b3-1f849a48034f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:40.419708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:40.451809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:40.452425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:40.452705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:40.453001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] PATH_INFO: `/v3/users/c8af239ae81b4624a7b63b5c2a66cf07` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:40.466581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] RBAC: Authorizing `identity:get_user(user_id=c8af239ae81b4624a7b63b5c2a66cf07)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:40.468033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:40.469662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 594/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:40 2022] GET /identity/v3/users/c8af239ae81b4624a7b63b5c2a66cf07 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:40.476004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:40.583159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0d32b-6d89-4c30-a3b6-3f42c8d6f010 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:40.618175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:40.618768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:40.619037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:40.619304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:40.662229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:40.689857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:40.691307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:40.813303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 589/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:40.819642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:40.924888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a350264-ba16-4d6d-88d5-20cabbeedfd5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:40.963215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23a7b-45ef-4bb8-961d-9c1d6dd652c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:40.963841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23a7b-45ef-4bb8-961d-9c1d6dd652c1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:40.964116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23a7b-45ef-4bb8-961d-9c1d6dd652c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:40.964382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23a7b-45ef-4bb8-961d-9c1d6dd652c1 None admin] PATH_INFO: `/v3/projects/50d4bf7452d44c389b27cb0fc796ab84` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:40.965597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c23a7b-45ef-4bb8-961d-9c1d6dd652c1 None admin] RBAC: Authorizing `identity:get_project(project_id=50d4bf7452d44c389b27cb0fc796ab84)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:40.967021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c23a7b-45ef-4bb8-961d-9c1d6dd652c1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:40.968598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 595/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:40 2022] GET /identity/v3/projects/50d4bf7452d44c389b27cb0fc796ab84 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:40.974872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:41.053636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:41.079518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aec0e-be5c-40da-9d64-375c5cdf5676 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:41.123320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:41.123919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:41.124197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:41.124462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:41.125205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=50d4bf7452d44c389b27cb0fc796ab84, user.id=c8af239ae81b4624a7b63b5c2a66cf07) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:41.125514 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:41.127287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e48e04-54b0-48a8-99a0-c50eb78b7bc3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:41.132686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 590/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:55:40 2022] GET /identity/v3/role_assignments?user.id=c8af239ae81b4624a7b63b5c2a66cf07&scope.project.id=50d4bf7452d44c389b27cb0fc796ab84&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:42.962311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a251c75-6502-4218-84bb-bdba33875a52 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:42.963131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a251c75-6502-4218-84bb-bdba33875a52 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:42.963131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a251c75-6502-4218-84bb-bdba33875a52 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:42.965255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 596/1186] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:42.971434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:42.972140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:42.972301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:42.997055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:42.998258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:43.068716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 591/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:43.329553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a251c75-6502-4218-84bb-bdba33875a52 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:43.369522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:43.452906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a251c75-6502-4218-84bb-bdba33875a52 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:43.488818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:43.489465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:43.489740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:43.490010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:43.501540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:55:43.506634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:43.507670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:55:43.508566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 597/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:43.517568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:43.583997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:43.617410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb2f02-97f5-467f-b571-edf924ea889a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:43.653410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:43.654002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:43.654274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:43.654539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:43.655215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:43.655511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:43.656920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:43.664989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 592/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:43.673656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:43.767393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:43.777786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7973-bca3-41ab-b55a-4584907ee750 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:43.812715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:43.813360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:43.813635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:43.813902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] PATH_INFO: `/v3/users/c8af239ae81b4624a7b63b5c2a66cf07` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:43.815229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c8af239ae81b4624a7b63b5c2a66cf07)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:43.816665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:43.818301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 598/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:43 2022] GET /identity/v3/users/c8af239ae81b4624a7b63b5c2a66cf07 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:43.827699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:43.939808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281e2ec-de18-4b07-8922-2f5d3cbc4eaf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:43.968582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:43.975244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2f7ee-ae3b-45d0-bf42-151b597eb280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:43.975844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2f7ee-ae3b-45d0-bf42-151b597eb280 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:43.976156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2f7ee-ae3b-45d0-bf42-151b597eb280 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:43.976426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2f7ee-ae3b-45d0-bf42-151b597eb280 None admin] PATH_INFO: `/v3/projects/50d4bf7452d44c389b27cb0fc796ab84` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:43.977593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2f7ee-ae3b-45d0-bf42-151b597eb280 None admin] RBAC: Authorizing `identity:get_project(project_id=50d4bf7452d44c389b27cb0fc796ab84)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:43.979029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2f7ee-ae3b-45d0-bf42-151b597eb280 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:43.980643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 593/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:43 2022] GET /identity/v3/projects/50d4bf7452d44c389b27cb0fc796ab84 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:43.989202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:44.103787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbb72-7206-4498-9024-f868b53e78a5 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:44.139595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928117a-0597-435f-bd26-eca7edf124a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:44.140235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928117a-0597-435f-bd26-eca7edf124a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:44.140516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928117a-0597-435f-bd26-eca7edf124a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:44.140791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928117a-0597-435f-bd26-eca7edf124a4 None admin] PATH_INFO: `/v3/projects/50d4bf7452d44c389b27cb0fc796ab84/users/c8af239ae81b4624a7b63b5c2a66cf07/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:44.143037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928117a-0597-435f-bd26-eca7edf124a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=50d4bf7452d44c389b27cb0fc796ab84, user_id=c8af239ae81b4624a7b63b5c2a66cf07, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:44.144470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928117a-0597-435f-bd26-eca7edf124a4 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:44.160532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 599/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:55:43 2022] PUT /identity/v3/projects/50d4bf7452d44c389b27cb0fc796ab84/users/c8af239ae81b4624a7b63b5c2a66cf07/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:55:46.007721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331290-9716-4ebf-97a3-b8bf9742fdb7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:46.008542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331290-9716-4ebf-97a3-b8bf9742fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:46.008542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331290-9716-4ebf-97a3-b8bf9742fdb7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:46.010827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 594/1193] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:55:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:55:46.016262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:46.016695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:46.016820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:46.036847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:55:46.038049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:55:46.051217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:46.108265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 600/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:55:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:55:46.379973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331290-9716-4ebf-97a3-b8bf9742fdb7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:46.494327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331290-9716-4ebf-97a3-b8bf9742fdb7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:46.529051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19049930-e888-4308-8841-618e318597a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:46.529672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19049930-e888-4308-8841-618e318597a8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:46.529948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19049930-e888-4308-8841-618e318597a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:46.530190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19049930-e888-4308-8841-618e318597a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:46.541278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19049930-e888-4308-8841-618e318597a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-19049930-e888-4308-8841-618e318597a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:55:46.545975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:55:46.547065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:55:46.548112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 595/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:55:46.553527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:46.668687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4a946-aa3f-48b5-a099-136d05a298a8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:46.707674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:46.708289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:46.708567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:46.708842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:46.709518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:46.709814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:46.711173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:46.719537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 601/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:46.725663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19049930-e888-4308-8841-618e318597a8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:46.797344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:46.849876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19049930-e888-4308-8841-618e318597a8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:46.886203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:46.886829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:46.887104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:46.887374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] PATH_INFO: `/v3/users/c8af239ae81b4624a7b63b5c2a66cf07` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:46.888609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] RBAC: Authorizing `identity:get_user(user_id=c8af239ae81b4624a7b63b5c2a66cf07)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:46.890086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:46.891651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 596/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Aug 31 03:55:46 2022] GET /identity/v3/users/c8af239ae81b4624a7b63b5c2a66cf07 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:46.898091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:46.912408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:47.005884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5acd2-ec0c-4b01-a64d-55ba49ccce26 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:47.040269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:47.040906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:47.041157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:47.041426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:47.115837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:47.117313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:47.130233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:47.222065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 602/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:55:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:55:47.228316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:47.342734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0d46-b739-4f86-a7ae-2a5d4eb32386 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:47.367945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:47.378103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77d3fe-620c-48b3-bd39-24a9d12f27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:47.378722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d3fe-620c-48b3-bd39-24a9d12f27b1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:47.379000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d3fe-620c-48b3-bd39-24a9d12f27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:47.379271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d3fe-620c-48b3-bd39-24a9d12f27b1 None admin] PATH_INFO: `/v3/projects/50d4bf7452d44c389b27cb0fc796ab84` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:47.380445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d3fe-620c-48b3-bd39-24a9d12f27b1 None admin] RBAC: Authorizing `identity:get_project(project_id=50d4bf7452d44c389b27cb0fc796ab84)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:47.381906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d3fe-620c-48b3-bd39-24a9d12f27b1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:47.383517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 597/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Aug 31 03:55:47 2022] GET /identity/v3/projects/50d4bf7452d44c389b27cb0fc796ab84 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:47.389872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:55:47.504098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e14a-8b4b-47ff-b964-c991eeca56f2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:55:47.514910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:47.540432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:55:47.541067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:55:47.541344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:55:47.541612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:55:47.542332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=50d4bf7452d44c389b27cb0fc796ab84, user.id=c8af239ae81b4624a7b63b5c2a66cf07) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:55:47.542639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:55:47.544065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063b60d-faa0-43c9-9508-4bfb7d3f86f6 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:55:47.549799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 603/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:55:47 2022] GET /identity/v3/role_assignments?user.id=c8af239ae81b4624a7b63b5c2a66cf07&scope.project.id=50d4bf7452d44c389b27cb0fc796ab84&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:55:57.373693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:55:57.547231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=13 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:42.715136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e30e3-9186-4fa6-89e3-06382a7b4752 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:42.715696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e30e3-9186-4fa6-89e3-06382a7b4752 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:42.715696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e30e3-9186-4fa6-89e3-06382a7b4752 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:42.717327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 598/1201] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:56:42.723212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:42.728248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:42.728248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:42.748470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:56:42.750296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:56:42.835866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 604/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:56:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 03:56:43.145924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e30e3-9186-4fa6-89e3-06382a7b4752 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:43.278410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e30e3-9186-4fa6-89e3-06382a7b4752 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:43.324044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:43.324733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:43.325073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:43.325276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:43.343034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:43.344586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:43.361540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:43.362635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:43.363622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:43.363622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:43.363622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:56:43.365182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 599/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:43.371909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:43.498386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc5ac-58f2-43a9-b8dc-ef6c0568d988 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:43.538850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:43.546042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:43.547111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:43.547703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:43.548245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:43.549069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:43.549374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:43.550790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a4f39-1d86-49c9-9cfc-795d1ce37de1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:43.568846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 605/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:56:43.570919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:43.647681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:43.712870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843952-54ed-490d-872d-c9776857e7d2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:43.756199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f562c-e1cb-40c5-82a4-ed0909ab9952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:43.756892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f562c-e1cb-40c5-82a4-ed0909ab9952 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:43.757174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f562c-e1cb-40c5-82a4-ed0909ab9952 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:43.757437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f562c-e1cb-40c5-82a4-ed0909ab9952 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:43.758175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f562c-e1cb-40c5-82a4-ed0909ab9952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:43.759791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f562c-e1cb-40c5-82a4-ed0909ab9952 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:43.787846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 600/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Aug 31 03:56:43 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:56:46.060605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac3445-a014-42a3-89bc-ebc0140d88b0 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:46.061219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac3445-a014-42a3-89bc-ebc0140d88b0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:46.061328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac3445-a014-42a3-89bc-ebc0140d88b0 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:46.062674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 606/1206] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:56:46.068218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:46.068645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:46.068859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:46.089055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:56:46.090401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:56:46.170270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 601/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:56:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:56:46.450124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac3445-a014-42a3-89bc-ebc0140d88b0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:46.578840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac3445-a014-42a3-89bc-ebc0140d88b0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:46.622845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84919728-378d-458c-88e4-004264f63f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:46.623555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84919728-378d-458c-88e4-004264f63f54 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:46.623744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84919728-378d-458c-88e4-004264f63f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:46.624064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84919728-378d-458c-88e4-004264f63f54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:46.635075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84919728-378d-458c-88e4-004264f63f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-84919728-378d-458c-88e4-004264f63f54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:56:46.640191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:46.641253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:56:46.644432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:46.647480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:46.649594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 607/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:56:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:46.697914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:46.770394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9120-d4d3-4c4a-bba1-d06196168ca1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:46.808131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:46.808756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:46.809073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:46.809349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:46.810063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:46.810411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:46.812414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:46.822494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 602/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:56:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:46.828479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84919728-378d-458c-88e4-004264f63f54 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:46.887077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:46.946919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84919728-378d-458c-88e4-004264f63f54 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:46.985328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:46.986360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:46.986360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:46.986566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:46.997744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:46.999929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:47.017508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:47.019821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:47.021006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:47.021006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:47.021006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:47.024272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 608/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:47.025475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:47.143495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:47.148197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a844c-737c-40e4-a935-3eadf1f7e1dd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:47.186826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:47.187655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:47.188001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:47.188348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:47.189144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:47.189528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:47.191309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:47.210785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 603/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:47.212419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:47.322773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ce29-0bbc-4a61-8aa0-b6a57be4b0f2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:47.324295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:47.361872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:47.362558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:47.362813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:47.363074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:47.371198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:47.372698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:56:47.387059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:47.394606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:47.395814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 609/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:47.396573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:47.518724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfcced-b85d-4900-a4cc-ae3a84883fab None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:47.563536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:47.564480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:47.564933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:47.565358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:47.566105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:47.566473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:47.568191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:47.591061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 604/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Aug 31 03:56:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:47.596575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:47.730976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b7b70-4252-4c7c-877c-d71f79371a45 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:47.776893 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:47.777648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:47.777951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:47.778246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:47.818285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:47.867015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:47.868592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:47.986576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 610/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:56:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 03:56:47.994534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:48.015970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:48.110542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542724b6-22fa-4a84-8856-a8b0235dec6f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:48.158887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:48.159510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:48.159764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:48.159995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:48.171928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:48.173724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:48.192077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:48.193220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:48.194135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:48.194135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:48.194135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:56:48.194135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 605/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:48.200787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:48.272676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:48.311698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2e4d3-5791-4cfe-b8e7-f4da6585207b None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:48.347023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:48.347615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:48.347885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:48.348149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:48.348789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:48.349113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:48.350476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:48.363468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 611/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:56:48.369634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:48.444081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:48.477947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740b0a-0a88-4cfc-9a1a-d68090c0dcc1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:48.516916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:48.517672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:48.517956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:48.518223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:48.525226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:48.526678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:56:48.539177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:48.540623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:56:48.541884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 606/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:48.546804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:48.650529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2fac0-8088-437c-9c02-bfa254d26657 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:48.674545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:48.694232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:48.694969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:48.695282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:48.695555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:48.696394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:48.698792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:48.700494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b082-df33-45c4-b9d3-94bf7d01a1d2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:48.720949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 612/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:56:48.727423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:48.871813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f3c00-39b0-4a3a-a678-17f9fbf8aa01 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:48.903583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:48.909604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:48.910217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:48.910501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:48.910775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:48.911509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=fa033d69cc014795896c16c63414f4a6) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:48.911817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:48.913302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6808c6-face-4ed2-b5b9-ee3ad6772979 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:48.918766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 607/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:56:48 2022] GET /identity/v3/role_assignments?user.id=fa033d69cc014795896c16c63414f4a6&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:50.907761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ed43-f394-47cf-af89-5fd974a12807 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:50.908327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ed43-f394-47cf-af89-5fd974a12807 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:50.908327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ed43-f394-47cf-af89-5fd974a12807 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:50.909695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 613/1220] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:56:50.915383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:50.915866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:50.915965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:50.935332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:56:50.936571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:56:51.010831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 608/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:56:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:56:51.303851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90ed43-f394-47cf-af89-5fd974a12807 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:51.417372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90ed43-f394-47cf-af89-5fd974a12807 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:51.451990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:51.452622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:51.452983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:51.453253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:51.463365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:56:51.468164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:51.472911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:51.474022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 614/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:56:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:51.476274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:51.580144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd2f3e-b56b-4a09-a562-a0674d1eae39 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:51.611543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:51.623318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:51.623944 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:51.624222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:51.624493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:51.625254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:51.625558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:51.627240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:51.636565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 609/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:51.643382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:51.691984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:51.756111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6256a-f3e3-41e5-b260-fb7f624b3a8c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:51.790837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:51.791475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:51.791754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:51.792023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:51.803221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:51.804405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:51.820973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:51.822199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:51.823312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:51.823312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:51.823312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:51.823312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 615/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:56:51.828821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:51.932913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76ff6a-5852-40ee-a80a-3ad2f72026e1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:51.969298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:51.969909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:51.970186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:51.970456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:51.971099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:51.971407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:51.972770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:51.985190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 610/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:51.991335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:52.103512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734af5a-bf9f-4c8e-8b93-5c40e8e8efed None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:52.105311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:52.143057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:52.143687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:52.143959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:52.144225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:52.151873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:52.153432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:56:52.165211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:52.166354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:52.167644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 616/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:52.172971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:52.227261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:52.286224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e73353-1373-4b4e-8362-ed1cb0d60fff None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:52.322758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:52.323583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:52.324013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:52.324274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:52.325292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:52.325639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:52.327407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:52.346474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 611/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Aug 31 03:56:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:52.353198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:52.458625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b333ea-2718-43d0-b52d-a7f17108ae82 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:52.497930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:52.498157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:52.498467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:52.498666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:52.511732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:52.513202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:52.527272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:52.529060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:52.530580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:52.530580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:52.530580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:52.530580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 617/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:52.534685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:52.644313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac78944-400a-4624-a4a1-042551ab9bd8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:52.647568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:52.684400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:52.685054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:52.685330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:52.685597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:52.686239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:52.686542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:52.688028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:52.702217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 612/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:52.708483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:52.719355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:52.822364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1c951-c96c-411e-bfad-da0597a61048 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:52.858631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:52.859338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:52.859615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:52.859966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:52.867169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:52.868696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:56:52.881159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:52.882104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:52.883019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 618/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:52.888674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:53.004378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78653c5c-91cb-40d6-880b-c16ba84ee326 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:53.042589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:53.043307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:53.043574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:53.043873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:53.044698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:53.045029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:53.048046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58878b90-3356-4295-9f7c-9ade752704b1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:53.061841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 613/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:53.068542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:53.142950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:53.181709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e97696-2a02-4681-9357-7b407ce6eba0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:53.219553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab48a3-d107-49b8-8891-808f2af1a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:53.220375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab48a3-d107-49b8-8891-808f2af1a2ab None admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:53.220618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab48a3-d107-49b8-8891-808f2af1a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:53.220932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab48a3-d107-49b8-8891-808f2af1a2ab None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/fa033d69cc014795896c16c63414f4a6/roles/1879d0da387f4397abd072af56a60001` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:53.237320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab48a3-d107-49b8-8891-808f2af1a2ab None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=fa033d69cc014795896c16c63414f4a6, role_id=1879d0da387f4397abd072af56a60001)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:53.238884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab48a3-d107-49b8-8891-808f2af1a2ab None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:53.253092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 619/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:56:53 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/fa033d69cc014795896c16c63414f4a6/roles/1879d0da387f4397abd072af56a60001 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:56:55.397459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5ca1-b843-4c61-ba44-9d768d3e3f47 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:55.398046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5ca1-b843-4c61-ba44-9d768d3e3f47 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:55.398046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5ca1-b843-4c61-ba44-9d768d3e3f47 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:55.399472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 614/1233] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:56:55.405127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:55.405678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:55.405678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:55.425938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:56:55.427113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:56:55.499789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 620/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:56:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:56:55.767364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5ca1-b843-4c61-ba44-9d768d3e3f47 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:55.802558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:55.888116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5ca1-b843-4c61-ba44-9d768d3e3f47 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:55.925836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:55.926512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:55.926810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:55.927113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:55.937634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:56:55.942399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:55.943643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:56:55.944820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 615/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Aug 31 03:56:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 03:56:55.949634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:56.000521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:56.060296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2bac-0c5d-4a32-afe6-a3d84c5508c0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:56.099317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:56.099942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:56.100222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:56.100498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:56.101198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:56.101497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:56.102862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:56.115885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 621/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Aug 31 03:56:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:56.117187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:56.209487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:56.226699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b3ca-8b18-43fc-9a92-a702bd02d197 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:56.262389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:56.263015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:56.263337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:56.263624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:56.275798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:56.277448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:56.294599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:56.295661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:56.296581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:56.296581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:56.296581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:56:56.296581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 616/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:56.302149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:56.404010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b373-7eca-42f4-b96b-4399bebabd35 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:56.413797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:56.440237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:56.441035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:56.441356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:56.441693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:56.442397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:56.442797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:56.444328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:56.457489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 622/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:56.464059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:56.573962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380cd2f-d50b-42a6-aecd-ac068c00ad00 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:56.608372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:56.609074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:56.609379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:56.609602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:56.612577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:56.618410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:56.619853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:56:56.631492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:56.632752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:56:56.633994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 617/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:56.638664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:56.751299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a7b6-1cc1-4817-8a90-7f7e25afd994 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:56.789070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:56.789722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:56.790000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:56.790286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:56.791085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:56.791466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:56.793286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:56.812455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 623/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Aug 31 03:56:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:56.818570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:56.929653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86f2b-5275-4880-9f58-c77514b83b01 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:56.967738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:56.968456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:56.968777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:56.969074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:57.036090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:57.047413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:57.049071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:57.159341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 618/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:56:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:56:57.166002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:57.196904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:57.283360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b896a8-d8be-4634-a634-36b12292e8dd None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:57.324129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:57.324757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:57.325074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:57.325344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:57.335454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:57.336913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:56:57.355371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:57.356571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:56:57.357970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:56:57.357970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:56:57.357970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:57.357970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 624/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:57.362488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:57.470853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:57.477628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f408e76-4894-4a22-9cfa-66dd2f791314 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:57.514234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:57.514838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:57.515118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:57.515484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:57.516130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:57.516420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:57.517815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:57.530138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 619/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:57.535136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:57.624446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:56:57.653470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7968456-7a60-4ae2-8b3a-48ed906137a0 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:57.697013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:57.697753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:57.698087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:57.698355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:57.705884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:57.707495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:56:57.720164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:56:57.721289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:56:57.722282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 625/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:56:57.728196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:57.857208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219f0b-9542-4537-8ea1-66aff887f6f0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:57.896427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:57.897075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:57.897428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:57.897625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:57.898469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:57.898699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:57.900395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea316e66-ac66-4d53-8a21-22175f24b0f8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:57.914765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 620/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:56:57.921513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:56:58.034110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae68796-00f7-4ca3-87a4-fe0bd72b4759 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:56:58.074551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:56:58.075264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:56:58.075660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:56:58.075965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:56:58.076896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] RBAC: Adding query filter params (role.id=1879d0da387f4397abd072af56a60001, scope.project.id=7514901da21f40398a0143744fd11757, user.id=fa033d69cc014795896c16c63414f4a6) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:56:58.077272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:56:58.079008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc943c-2c1b-4358-9bde-b5a210e8e916 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:56:58.096903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 626/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:56:57 2022] GET /identity/v3/role_assignments?user.id=fa033d69cc014795896c16c63414f4a6&scope.project.id=7514901da21f40398a0143744fd11757&role.id=1879d0da387f4397abd072af56a60001 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:00.158301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318acd-0c22-4b19-8a46-36b720440161 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:00.159293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318acd-0c22-4b19-8a46-36b720440161 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:00.159293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318acd-0c22-4b19-8a46-36b720440161 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:00.160359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 621/1247] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:00.166070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:00.166532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:00.166673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:00.174075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:00.190735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:00.192166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:00.276660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 627/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:00.534466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318acd-0c22-4b19-8a46-36b720440161 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:00.557468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:00.649833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318acd-0c22-4b19-8a46-36b720440161 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:00.689396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:00.690117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:00.690387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:00.690660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:00.703615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:57:00.708775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:00.709826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:00.710689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 622/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:00.716045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:00.837437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc41e4-e4ee-43a6-b391-19c394f8046f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:00.872599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:00.879213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:00.880016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:00.880394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:00.880677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:00.881604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:00.881818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:00.883357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:00.893171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 628/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:00.899845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:00.991319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:01.016675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536f04e-09ae-48fb-85cd-39e975a2ace0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:01.060190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:01.061377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:01.061631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:01.062174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:01.076617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:01.078166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:57:01.097248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:01.098414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:57:01.099450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:57:01.099450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:01.099450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:01.099450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 623/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:01.105057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:01.214873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1665e1b-5647-4ef6-aa5d-6789416b9a6f None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:01.252881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:01.253494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:01.253878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:01.254237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:01.255044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:01.255364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:01.256986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:01.270969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 629/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:01.276947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:01.393905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfbd76-d305-482f-a10e-ea35b098193e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:01.425413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:01.434351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:01.435006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:01.435283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:01.435552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:01.445340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:01.446790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:57:01.458051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:01.459285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:01.460449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 624/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:01.465180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:01.528023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:01.575416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee20b9-ad72-408f-a938-aeae6e7e3974 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:01.617757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:01.618436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:01.618716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:01.619014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:01.619789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:01.620152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:01.621734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:01.642116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 630/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Aug 31 03:57:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:01.648445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:01.771120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a9d1e-7ba0-4418-8a07-60aae3aee9e1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:01.808912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:01.809551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:01.809799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:01.810064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:01.865442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:01.880463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:01.882175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:01.991929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 625/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:57:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:57:01.997888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:02.107594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d395-a60c-4fa2-96f0-05475e587e69 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:02.123107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:02.152302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:02.153171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:02.153564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:02.153878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:02.164794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:02.166261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:57:02.180705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:02.181916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:57:02.183325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:57:02.183325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:02.183325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:02.183325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 631/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:02.187673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:02.282115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:02.296622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a09b-b0d9-4658-937e-0a56e175d4a2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:02.341021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:02.341684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:02.342007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:02.342314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:02.343196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:02.343540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:02.345189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:02.358642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 626/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:02.364291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:02.474649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628ebd8-3037-4d3c-9dd7-e8eecf5989f1 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:02.511357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:02.511989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:02.512265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:02.512532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:02.519239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:02.520685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:57:02.532059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:02.533529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:57:02.534659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:02.540833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 632/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:02.540986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:02.654547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39666ce-1fdd-4f64-823f-73e704fcb999 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:02.695305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:02.696054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:02.696419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:02.696772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:02.697637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:02.698027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:02.699636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9088e-97d6-4109-b5dd-59a84744a630 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:02.717530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 627/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:02.723817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:02.753158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:02.835153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488966e-33d5-4c95-b09f-67a538ac2614 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:02.869877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:02.870483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:02.870756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:02.871017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:02.871733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7514901da21f40398a0143744fd11757, user.id=fa033d69cc014795896c16c63414f4a6) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:02.872033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:02.873535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586547f2-82cf-4335-9ddd-08707cf858c5 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:02.879229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 633/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:57:02 2022] GET /identity/v3/role_assignments?user.id=fa033d69cc014795896c16c63414f4a6&scope.project.id=7514901da21f40398a0143744fd11757&role.id=faea311d34554d2b9ce4434210a27c8f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:04.840678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607dcf-f6ef-45ba-8263-d712a4aaca68 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:04.841544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607dcf-f6ef-45ba-8263-d712a4aaca68 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:04.841649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607dcf-f6ef-45ba-8263-d712a4aaca68 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:04.843755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 628/1261] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:04.850162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:04.850637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:04.850753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:04.873858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:04.875038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:04.956152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 634/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:05.232539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607dcf-f6ef-45ba-8263-d712a4aaca68 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:05.245109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:05.359249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607dcf-f6ef-45ba-8263-d712a4aaca68 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:05.394652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:05.395272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:05.395552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:05.395822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:05.407589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:57:05.412399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:05.413630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:05.414663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 629/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:05.419640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:05.439962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:05.530160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ec2ef-67bd-4d2d-80cb-1dcea2ab97aa None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:05.564878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:05.565481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:05.565750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:05.566015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:05.566667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:05.566959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:05.568320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:05.576292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 635/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:57:05.585338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:05.656448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:05.695799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28ced-1796-49ad-a0d7-415f2d10b16c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:05.734386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:05.735032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:05.735327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:05.735626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:05.747144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:05.748984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:57:05.764950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:05.766035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:57:05.766963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:57:05.766963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:05.766963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:05.766963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 630/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:05.774233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:05.858247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:05.878911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961dff3-9673-45c8-bc1a-0e74cf5a43e8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:05.914282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:05.914879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:05.915154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:05.915425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:05.916067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:05.916372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:05.917755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:05.930429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 636/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:05.938449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:06.056869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c9767-0a39-409a-8323-e1e2834ba970 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:06.080554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:06.097089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:06.097731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:06.098013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:06.098285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:06.106471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:06.107970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:57:06.119784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:06.120877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:06.121994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 631/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:06.127828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:06.240649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92369e-e30d-460b-9811-a90efa026052 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:06.275252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:06.275844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:06.276120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:06.276386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:06.277127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:06.277429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:06.278831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:06.287436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:06.296397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 637/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Aug 31 03:57:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:06.302181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:06.407024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9c47-02a5-4f3a-a969-ca733db8f0ea None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:06.443447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:06.444064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:06.444335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:06.444604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:06.455571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:06.457061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:57:06.471750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:06.472836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:57:06.473752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:57:06.473752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:06.473752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:06.473752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 632/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:06.481466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:06.593640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc140-e296-4d8d-90b7-cb018e898ed7 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:06.630528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:06.631122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:06.631403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:06.631675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:06.632315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:06.632616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:06.634022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:06.645261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 638/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:06.650942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:06.684159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:06.763286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb374f8-6dce-4784-bc84-6be82058886a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:06.807145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:06.807770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:06.808046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:06.808318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:06.815782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:06.817262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:57:06.828489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:06.829605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:06.830777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 633/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:06.835685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:06.899432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:06.944680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1294c4-1a48-4746-97fc-7f12b75304a9 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:06.988954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:06.989554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:06.989831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:06.990099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:06.990785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:06.991083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:06.992512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc193f9a-6c8a-4fbf-b91d-8280f60c3e00 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:07.005216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 639/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:07.011444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:07.124536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:07.135778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b85113-0ec7-4a17-83e4-f6a0509dbcb5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:07.173277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3252d2b-232d-40ed-8a90-68cda9a6a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:07.173926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252d2b-232d-40ed-8a90-68cda9a6a4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:07.174201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252d2b-232d-40ed-8a90-68cda9a6a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:07.174480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252d2b-232d-40ed-8a90-68cda9a6a4b1 None admin] PATH_INFO: `/v3/projects/7514901da21f40398a0143744fd11757/users/fa033d69cc014795896c16c63414f4a6/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:07.176610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252d2b-232d-40ed-8a90-68cda9a6a4b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7514901da21f40398a0143744fd11757, user_id=fa033d69cc014795896c16c63414f4a6, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:07.178095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252d2b-232d-40ed-8a90-68cda9a6a4b1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:07.197836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 634/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Aug 31 03:57:07 2022] PUT /identity/v3/projects/7514901da21f40398a0143744fd11757/users/fa033d69cc014795896c16c63414f4a6/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:57:09.050562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c2fad-1481-4187-a2d9-e8cedbc28558 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:09.051738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c2fad-1481-4187-a2d9-e8cedbc28558 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:09.051738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c2fad-1481-4187-a2d9-e8cedbc28558 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:09.053625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 640/1274] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:09.060775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:09.061274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:09.061395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:09.081794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:09.082987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:09.152043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 635/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:09.418894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c2fad-1481-4187-a2d9-e8cedbc28558 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:09.535331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c2fad-1481-4187-a2d9-e8cedbc28558 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:09.552547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:09.570622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:09.571240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:09.571517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:09.571782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:09.581762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 03:57:09.586489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:09.587537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:09.588591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 641/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Aug 31 03:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:09.593792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:09.678420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:09.698854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbee24-cdb3-41ce-8d34-f1d06bd85cef None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:09.756988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:09.757665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:09.757974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:09.758269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:09.759006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:09.759352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:09.760914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:09.770412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 636/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Aug 31 03:57:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:09.779688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:09.880825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f75f0-7d4c-4f43-83ba-b530d214499c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:09.915379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:09.916019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:09.916287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:09.916547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:09.926920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:09.928335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:57:09.943220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:09.944317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:57:09.945600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:57:09.945600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:09.945600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:09.945600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 642/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:09.950955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:10.069256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d054d-e90f-4d0b-97f9-ee9e6dee1c55 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:10.105517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:10.106179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:10.106495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:10.106789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:10.107515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:10.107859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:10.109455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:10.121851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 637/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:10.128251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:10.161480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:10.233829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb765da-a02d-4417-a637-a8ddef309a57 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:10.275332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:10.275950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:10.276223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:10.276494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:10.284083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:10.285538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 03:57:10.296544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:10.297929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:10.299308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 643/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:10.306397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:10.312709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:10.417704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef88ab-0e03-4177-bb47-fba6aa25e429 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:10.452913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:10.453507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:10.453781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:10.454043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:10.454763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:10.455069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:10.456487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:10.473283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 638/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Aug 31 03:57:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:10.482868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:10.589489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:10.599755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556c49-6ffb-4fad-800a-46adcb7ab11c None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:10.634304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:10.634895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:10.635167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:10.635418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:10.708304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:10.709768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:10.798440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:10.815725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 644/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Aug 31 03:57:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 03:57:10.821828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:10.888405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:10.931910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67421-8337-4b40-bada-4f12c6f73c61 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:10.970142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:10.970763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:10.971040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:10.971309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:10.981642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:10.983089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 03:57:10.997752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:10.998831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 03:57:11.000126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 03:57:11.000126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 03:57:11.000126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:11.000126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 639/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 03:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:11.008373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:11.123721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b6bca-c4f0-498a-aaf8-840a47a64ce8 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:11.160867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:11.161463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:11.161669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:11.161931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:11.162566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:11.162857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:11.164218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:11.175364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 645/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Aug 31 03:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:11.181961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:11.290530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0c31-c3a0-4d1b-bf10-9c6a0d5e4e7a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:11.306124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:11.328000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:11.328622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:11.328938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:11.329228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:11.335886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:11.337356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 03:57:11.349460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:11.350553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 31 03:57:11.352325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 640/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Aug 31 03:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:11.359888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:11.418129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:11.472174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94978772-a9fb-4628-a47f-7dad44247c26 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:11.510761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:11.511347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:11.511614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:11.511880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:11.512564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:11.512867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:11.514302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861704e-7067-4e15-ab25-0f889981d333 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:11.526231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 646/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Aug 31 03:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:11.532821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:11.649918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c16202-1ecd-4049-ba98-fde2105186a3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:11.684893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:11.685412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:11.685685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:11.685958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:11.686699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] RBAC: Adding query filter params (role.id=faea311d34554d2b9ce4434210a27c8f, scope.project.id=7514901da21f40398a0143744fd11757, user.id=fa033d69cc014795896c16c63414f4a6) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:11.687046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:11.688461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b937-8f89-4fb9-8a9a-102910bd1268 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:11.698727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 641/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Aug 31 03:57:11 2022] GET /identity/v3/role_assignments?user.id=fa033d69cc014795896c16c63414f4a6&scope.project.id=7514901da21f40398a0143744fd11757&role.id=faea311d34554d2b9ce4434210a27c8f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:13.601524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf7c1-13d8-431c-8430-464811849db2 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:13.602113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf7c1-13d8-431c-8430-464811849db2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:13.602113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf7c1-13d8-431c-8430-464811849db2 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:13.603486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 647/1288] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:13.609760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:13.610493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:13.610645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:13.641987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:13.643769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:13.687322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:13.727688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 642/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:13.988928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf7c1-13d8-431c-8430-464811849db2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:14.107782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf7c1-13d8-431c-8430-464811849db2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:14.120030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:14.145031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:14.145654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:14.145930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:14.146204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:14.146778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:14.148153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:14.157159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:14.158343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:14.159231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 648/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:57:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:14.165378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:14.274957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a88a7-3df9-4a3f-88d9-efb1231537b5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:14.310250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:14.310846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:14.311118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:14.311384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:14.312052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:14.312353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:14.313733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cf785-dc57-4516-a7d9-8d24455cb9aa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:14.318592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 643/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Aug 31 03:57:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:14.324498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:14.431415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07972b51-8ef9-423d-a0ec-cbc5ed97ed6e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:14.467157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:14.467744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:14.468083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:14.468350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] PATH_INFO: `/v3/services` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:14.469001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:14.469306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:14.470635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ec0d-2230-4d8d-a1e9-45e0ce19d442 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:14.475174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 649/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Aug 31 03:57:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:16.312198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205ec0-24f7-44a5-bd77-e940eb70ea95 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:16.313143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205ec0-24f7-44a5-bd77-e940eb70ea95 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:16.313143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205ec0-24f7-44a5-bd77-e940eb70ea95 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:16.315231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 644/1293] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:16.321504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3489a8-9356-4a40-a00c-3193eba5e270 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:16.321948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3489a8-9356-4a40-a00c-3193eba5e270 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:16.322060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3489a8-9356-4a40-a00c-3193eba5e270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:16.344120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9f3489a8-9356-4a40-a00c-3193eba5e270 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:16.345338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9f3489a8-9356-4a40-a00c-3193eba5e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:16.378696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:16.420508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 650/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:16.683039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f205ec0-24f7-44a5-bd77-e940eb70ea95 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:16.720753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:16.793290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f205ec0-24f7-44a5-bd77-e940eb70ea95 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:16.836961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aac9dc-41d3-45e9-977a-52a14e1131ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:16.837563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac9dc-41d3-45e9-977a-52a14e1131ce None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:16.837840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac9dc-41d3-45e9-977a-52a14e1131ce None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:16.838105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac9dc-41d3-45e9-977a-52a14e1131ce None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:16.838753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aac9dc-41d3-45e9-977a-52a14e1131ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:16.840119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aac9dc-41d3-45e9-977a-52a14e1131ce None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:16.860659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 645/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Aug 31 03:57:16 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:57:18.757689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295236e4-b48a-49f2-9c7c-5f7272bc6ae4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:18.758557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295236e4-b48a-49f2-9c7c-5f7272bc6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:18.758557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295236e4-b48a-49f2-9c7c-5f7272bc6ae4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:18.760663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 651/1296] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:18.769378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:18.769802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:18.769973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:18.794170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:18.795333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:18.874665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 646/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:19.144059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295236e4-b48a-49f2-9c7c-5f7272bc6ae4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:19.262008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295236e4-b48a-49f2-9c7c-5f7272bc6ae4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:19.297282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae896-561e-4975-9717-80356134c63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:19.297894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae896-561e-4975-9717-80356134c63e None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:19.298165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae896-561e-4975-9717-80356134c63e None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:19.298429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae896-561e-4975-9717-80356134c63e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:19.299006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae896-561e-4975-9717-80356134c63e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:19.300356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae896-561e-4975-9717-80356134c63e None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-8dfae896-561e-4975-9717-80356134c63e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:19.308775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:19.309916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:19.311067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 652/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:57:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:19.316471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:19.340013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:19.437843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e5159-a69e-4cd4-aeb9-f53f866eda7f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:19.476376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:19.477010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:19.477285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:19.477550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:19.478181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:19.478483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:19.479845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:19.485036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 647/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Aug 31 03:57:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:19.491764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae896-561e-4975-9717-80356134c63e None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:19.527858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:19.597252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae896-561e-4975-9717-80356134c63e None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:19.632075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:19.632649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:19.632951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:19.633220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:19.633910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] RBAC: Adding query filter params (interface=public, service_id=11aceb28eb2d461d92d579d7056fd09b, region_id=RegionOne) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:19.634210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:19.635555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de43051-5a4f-4a0a-a0d8-9e5d77fc2283 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:19.640626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 653/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Aug 31 03:57:19 2022] GET /identity/v3/endpoints?service_id=11aceb28eb2d461d92d579d7056fd09b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:19.649723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:19.760057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:19.779253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193c30-6f7f-498c-811f-c2332b1e2fd8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:19.815546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa5db1-a998-4b2c-bf74-411cb5627be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:19.816152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5db1-a998-4b2c-bf74-411cb5627be0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:19.816432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5db1-a998-4b2c-bf74-411cb5627be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:19.816701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5db1-a998-4b2c-bf74-411cb5627be0 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:19.817345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa5db1-a998-4b2c-bf74-411cb5627be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:19.818726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa5db1-a998-4b2c-bf74-411cb5627be0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:19.825561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 648/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Aug 31 03:57:19 2022] GET /identity/v3/services => generated 2191 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:57:21.707009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63cff-56ec-4c3d-b52d-95dcb4bd94a8 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:21.707474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63cff-56ec-4c3d-b52d-95dcb4bd94a8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:21.707580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e63cff-56ec-4c3d-b52d-95dcb4bd94a8 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:21.708922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 654/1302] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:57:21.714340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:21.714757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:21.714867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:21.734396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:57:21.735670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:57:21.811110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 649/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:57:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 03:57:22.082773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63cff-56ec-4c3d-b52d-95dcb4bd94a8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:22.188019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:22.200272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e63cff-56ec-4c3d-b52d-95dcb4bd94a8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:22.236674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:22.237334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:22.237614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:22.237881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:22.238459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:22.239826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 03:57:22.248751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 03:57:22.249916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application with Lock( Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self._enter() Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application return self.creator() Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application created_value = creator( Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: ERROR keystone.server.flask.application Aug 31 03:57:22.251282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 655/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Aug 31 03:57:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 03:57:22.256384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:22.335382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:22.360108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3602e-4a97-48f6-b10d-699307372f27 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:22.395827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:22.396404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:22.396678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:22.397005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:22.397636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:57:22.397940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:22.399315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138523ce-5f20-456f-af15-33850b8b87d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:22.404570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 650/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Aug 31 03:57:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:57:22.410575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:57:22.539943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e930bb8-1ea1-475d-b6ac-a83253444dc2 None admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:57:22.578820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04954a41-2c00-4a3f-adb3-5899b9f1c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:57:22.579407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954a41-2c00-4a3f-adb3-5899b9f1c851 None admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:57:22.579683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954a41-2c00-4a3f-adb3-5899b9f1c851 None admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:57:22.579953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954a41-2c00-4a3f-adb3-5899b9f1c851 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:57:22.580623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04954a41-2c00-4a3f-adb3-5899b9f1c851 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:57:22.581999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04954a41-2c00-4a3f-adb3-5899b9f1c851 None admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:57:22.605228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 656/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 03:57:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:57:32.401622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=30 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:57:32.600970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:25.557689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab002-0de8-4feb-a1d5-c0dc4744f311 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:25.558264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab002-0de8-4feb-a1d5-c0dc4744f311 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:25.558264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab002-0de8-4feb-a1d5-c0dc4744f311 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:25.559645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 651/1307] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:25.565170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebab32-084e-41e7-94ab-efba92ca76de None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:25.565594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebab32-084e-41e7-94ab-efba92ca76de None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:25.565762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebab32-084e-41e7-94ab-efba92ca76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:25.649913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f1ebab32-084e-41e7-94ab-efba92ca76de None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:25.651119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f1ebab32-084e-41e7-94ab-efba92ca76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:25.888192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 657/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:26.177502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f75fe8-0b43-404c-9e27-f8ccd33ddefc None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:26.177917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f75fe8-0b43-404c-9e27-f8ccd33ddefc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:26.178281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f75fe8-0b43-404c-9e27-f8ccd33ddefc None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:26.179700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 652/1309] 10.222.0.25 () {54 vars in 965 bytes} [Wed Aug 31 03:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:26.185903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfe90f-2add-4857-933a-8145516d4ee2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:26.186147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfe90f-2add-4857-933a-8145516d4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:26.186446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfe90f-2add-4857-933a-8145516d4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:26.260527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c3bfe90f-2add-4857-933a-8145516d4ee2 None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:26.261744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c3bfe90f-2add-4857-933a-8145516d4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:26.282335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:26.340252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 658/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Wed Aug 31 03:58:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:58:26.349017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f75fe8-0b43-404c-9e27-f8ccd33ddefc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:26.350758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-14f75fe8-0b43-404c-9e27-f8ccd33ddefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:26.467791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f75fe8-0b43-404c-9e27-f8ccd33ddefc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:26.552042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:26.552663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:26.552982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:26.553251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:26.554943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:26.616073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:26.674208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:26.675659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a6f0-bc41-4189-9f65-6e4f7ac04bca service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:26.696963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 653/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:28.884794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c590-4d82-466d-a17f-dfe043cabceb None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:28.885348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c590-4d82-466d-a17f-dfe043cabceb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:28.885348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c590-4d82-466d-a17f-dfe043cabceb None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:28.886736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 659/1312] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:28.892660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97c5e5-88f1-49ff-8814-1b28be56ebf2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:28.893270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97c5e5-88f1-49ff-8814-1b28be56ebf2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:28.893270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97c5e5-88f1-49ff-8814-1b28be56ebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:28.977140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bf97c5e5-88f1-49ff-8814-1b28be56ebf2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:28.978402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bf97c5e5-88f1-49ff-8814-1b28be56ebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:29.085257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 654/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:29.380160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f2793-8306-44e4-9166-4c452cf762ee None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:29.380414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f2793-8306-44e4-9166-4c452cf762ee None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:29.380690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f2793-8306-44e4-9166-4c452cf762ee None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:29.382207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 660/1314] 10.222.0.25 () {54 vars in 965 bytes} [Wed Aug 31 03:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:29.387817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b9c9f-6ef8-4387-acf0-cccb08168e5b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:29.388103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b9c9f-6ef8-4387-acf0-cccb08168e5b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:29.388374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b9c9f-6ef8-4387-acf0-cccb08168e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:29.400154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:29.467676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-da0b9c9f-6ef8-4387-acf0-cccb08168e5b None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:29.468917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da0b9c9f-6ef8-4387-acf0-cccb08168e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:29.548560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 655/1315] 10.222.0.25 () {58 vars in 1062 bytes} [Wed Aug 31 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:29.557746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f2793-8306-44e4-9166-4c452cf762ee None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:29.559288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-507f2793-8306-44e4-9166-4c452cf762ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:29.680218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f2793-8306-44e4-9166-4c452cf762ee None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:29.757875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:29.760499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:29.761114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:29.761382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:29.761628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:29.764115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:29.879961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:29.881372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df94de-9564-4a7b-a1f6-d5a84f7e089a service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:29.900474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 661/1316] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:32.323847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338951fc-dc8e-49a4-b2e6-7d34590174bf None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:32.324909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338951fc-dc8e-49a4-b2e6-7d34590174bf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:32.324909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338951fc-dc8e-49a4-b2e6-7d34590174bf None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:32.326859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 656/1317] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:32.333045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1baebd-db1e-4dfc-9109-b8f3389e4d90 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:32.333770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1baebd-db1e-4dfc-9109-b8f3389e4d90 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:32.333885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1baebd-db1e-4dfc-9109-b8f3389e4d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:32.429657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fe1baebd-db1e-4dfc-9109-b8f3389e4d90 None None] MFA Rules not processed for user `376d2847725640009b54fa75123e3d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:32.430858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fe1baebd-db1e-4dfc-9109-b8f3389e4d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:32.491076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:32.538332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 662/1318] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:32.824264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338951fc-dc8e-49a4-b2e6-7d34590174bf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:32.826818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-338951fc-dc8e-49a4-b2e6-7d34590174bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:32.967114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338951fc-dc8e-49a4-b2e6-7d34590174bf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:32.970048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:33.060548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:33.061193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:33.061473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:33.061742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:33.063361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:33.185170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:33.186601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf6635-2b71-4582-80fa-66d391b96665 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:33.205863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 657/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:35.659060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490f94-946f-40d2-991d-27b3d0505455 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:35.661935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490f94-946f-40d2-991d-27b3d0505455 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:35.662436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490f94-946f-40d2-991d-27b3d0505455 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:35.664615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 663/1320] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:35.672026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e685f-55e2-4a4b-bfac-bfbffe9c3f61 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:35.672432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e685f-55e2-4a4b-bfac-bfbffe9c3f61 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:35.672620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e685f-55e2-4a4b-bfac-bfbffe9c3f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:35.714942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:35.742217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-171e685f-55e2-4a4b-bfac-bfbffe9c3f61 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:35.743412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-171e685f-55e2-4a4b-bfac-bfbffe9c3f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:35.856610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 658/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:36.139394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490f94-946f-40d2-991d-27b3d0505455 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:36.141923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-83490f94-946f-40d2-991d-27b3d0505455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:36.261225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490f94-946f-40d2-991d-27b3d0505455 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:36.360681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:36.361317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:36.361593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:36.361850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:36.363455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:36.370992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:36.485228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:36.486577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b2379-ede6-41c1-b78e-dd4611dea3df service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:36.505285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 664/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:39.034652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c193c-9e06-4ccf-a29b-77dcbb5c045e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:39.035246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c193c-9e06-4ccf-a29b-77dcbb5c045e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:39.035246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c193c-9e06-4ccf-a29b-77dcbb5c045e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:39.036702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 659/1323] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:39.041900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e55bd-41e9-4c5e-b02c-5ebd825a9a38 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:39.042412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e55bd-41e9-4c5e-b02c-5ebd825a9a38 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:39.042712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e55bd-41e9-4c5e-b02c-5ebd825a9a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:39.112436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5b5e55bd-41e9-4c5e-b02c-5ebd825a9a38 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:39.113650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b5e55bd-41e9-4c5e-b02c-5ebd825a9a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:39.174931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:39.216414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 665/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:39.492833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c193c-9e06-4ccf-a29b-77dcbb5c045e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:39.494461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-399c193c-9e06-4ccf-a29b-77dcbb5c045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:39.607762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c193c-9e06-4ccf-a29b-77dcbb5c045e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:39.620052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:39.684021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:39.684659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:39.684975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:39.685247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:39.686848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:39.801481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:39.802935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af072a6d-4d5d-4c94-8117-fe1716ccb607 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:39.821230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 660/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:41.749237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f030-2636-4234-a52e-95850fc28714 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:41.749755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f030-2636-4234-a52e-95850fc28714 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:41.749755 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f030-2636-4234-a52e-95850fc28714 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:41.751353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 666/1326] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:41.756837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65befc-81a4-4b43-9051-e42148f969ef None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:41.757332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65befc-81a4-4b43-9051-e42148f969ef None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:41.757669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65befc-81a4-4b43-9051-e42148f969ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:41.808395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:41.826966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1d65befc-81a4-4b43-9051-e42148f969ef None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:41.828209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d65befc-81a4-4b43-9051-e42148f969ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:41.928038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 661/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:42.214432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274f030-2636-4234-a52e-95850fc28714 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:42.216185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d274f030-2636-4234-a52e-95850fc28714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:42.333613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274f030-2636-4234-a52e-95850fc28714 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:42.411246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:42.411859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:42.412138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:42.412406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:42.414034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:42.432277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:42.529147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:42.530540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24667b-eccd-4c85-9bd1-e4d0cf4dd630 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:42.548607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 667/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:44.489645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d507d3-a5e1-4ba0-9879-b2f59a3327dd None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:44.490219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d507d3-a5e1-4ba0-9879-b2f59a3327dd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:44.490219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d507d3-a5e1-4ba0-9879-b2f59a3327dd None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:44.491533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 662/1329] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:44.497102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a97f6a-6bb3-4368-9459-b28e9e2965e5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:44.497628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a97f6a-6bb3-4368-9459-b28e9e2965e5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:44.497628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a97f6a-6bb3-4368-9459-b28e9e2965e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:44.571420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a1a97f6a-6bb3-4368-9459-b28e9e2965e5 None None] MFA Rules not processed for user `376d2847725640009b54fa75123e3d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:44.572667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a1a97f6a-6bb3-4368-9459-b28e9e2965e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:44.643898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:44.678899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 668/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:44.962377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d507d3-a5e1-4ba0-9879-b2f59a3327dd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:44.963958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f8d507d3-a5e1-4ba0-9879-b2f59a3327dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:45.069690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d507d3-a5e1-4ba0-9879-b2f59a3327dd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:45.090686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:45.146216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:45.146764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:45.147040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:45.147309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:45.149094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:45.261841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:45.263371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c269cf2-70f4-45d0-bb9c-dd79c928634e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:45.282430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 663/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:47.564631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb609751-50ba-43f1-90cb-3afcef32505f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:47.565228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb609751-50ba-43f1-90cb-3afcef32505f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:47.565228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb609751-50ba-43f1-90cb-3afcef32505f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:47.566586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 669/1332] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:47.572855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41ec1-6781-4b3e-a60e-cfc965df478b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:47.573528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41ec1-6781-4b3e-a60e-cfc965df478b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:47.573717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b41ec1-6781-4b3e-a60e-cfc965df478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:47.639868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:47.644178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-40b41ec1-6781-4b3e-a60e-cfc965df478b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:47.646199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-40b41ec1-6781-4b3e-a60e-cfc965df478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:47.751003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 664/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:48.028474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb609751-50ba-43f1-90cb-3afcef32505f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:48.030064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cb609751-50ba-43f1-90cb-3afcef32505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:48.139201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb609751-50ba-43f1-90cb-3afcef32505f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:48.235310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:48.235918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:48.236171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:48.236471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:48.238112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:48.266711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:48.357880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:48.359229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f699a-6eca-411b-a16d-71e90e870e28 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:48.379433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 670/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:50.315533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aa0f4-d22b-4561-a78d-ce59f86c66e2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:50.316441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aa0f4-d22b-4561-a78d-ce59f86c66e2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:50.316441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aa0f4-d22b-4561-a78d-ce59f86c66e2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:50.318580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 665/1335] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:50.327032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92e49c-f9c0-45dd-a7c4-09417afecc6a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:50.327763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92e49c-f9c0-45dd-a7c4-09417afecc6a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:50.327918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92e49c-f9c0-45dd-a7c4-09417afecc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:50.402760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8f92e49c-f9c0-45dd-a7c4-09417afecc6a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:50.403957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8f92e49c-f9c0-45dd-a7c4-09417afecc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:50.487450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:50.514077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 671/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:50.808318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aa0f4-d22b-4561-a78d-ce59f86c66e2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:50.810906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f01aa0f4-d22b-4561-a78d-ce59f86c66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:50.929060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aa0f4-d22b-4561-a78d-ce59f86c66e2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:50.966457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:51.015563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:51.016167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:51.016441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:51.016709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:51.018335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:51.136362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:51.137860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a6fb-efea-48d1-8fa7-482b062fc8e7 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:51.157861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 666/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:53.396079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b274c4-de57-4179-8396-77fe4f178ee4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:53.396640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b274c4-de57-4179-8396-77fe4f178ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:53.396640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b274c4-de57-4179-8396-77fe4f178ee4 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:53.398016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 672/1338] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:53.404558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99961-09bc-4bf2-9ef8-bc7f57e349be None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:53.405372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99961-09bc-4bf2-9ef8-bc7f57e349be None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:53.405562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99961-09bc-4bf2-9ef8-bc7f57e349be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:53.486473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aed99961-09bc-4bf2-9ef8-bc7f57e349be None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:53.487687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aed99961-09bc-4bf2-9ef8-bc7f57e349be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:53.496266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:53.591200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 667/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:53.876837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b274c4-de57-4179-8396-77fe4f178ee4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:53.879257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-24b274c4-de57-4179-8396-77fe4f178ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:54.001625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b274c4-de57-4179-8396-77fe4f178ee4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:54.082163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:54.082779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:54.083052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:54.083303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:54.084955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:54.120822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:54.206309 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:54.207742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8359b0-d7f5-444c-ac7f-12879ac87590 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:54.227285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 673/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:58:58.082491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02535f9a-256b-4b14-b037-a5d26c22a51b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:58.082996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02535f9a-256b-4b14-b037-a5d26c22a51b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:58.082996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02535f9a-256b-4b14-b037-a5d26c22a51b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:58.084516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 668/1341] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:58:58.090006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1be21-d6f8-4b7b-8b14-e9860fa9f702 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:58.090443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1be21-d6f8-4b7b-8b14-e9860fa9f702 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:58.090555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1be21-d6f8-4b7b-8b14-e9860fa9f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:58.160981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3fc1be21-d6f8-4b7b-8b14-e9860fa9f702 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:58:58.162172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3fc1be21-d6f8-4b7b-8b14-e9860fa9f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:58.254689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:58.266962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 674/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:58:58.543037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02535f9a-256b-4b14-b037-a5d26c22a51b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:58:58.544568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-02535f9a-256b-4b14-b037-a5d26c22a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:58.658378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02535f9a-256b-4b14-b037-a5d26c22a51b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:58:58.699574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:58:58.739562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:58:58.740190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:58:58.740470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:58:58.740740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:58:58.742497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:58:58.858093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:58:58.859477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f924b9-17e5-49b9-abda-94346841422c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:58:58.879629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 669/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:01.410923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeaab3-121e-42d7-9460-a362886425d6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:01.411455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeaab3-121e-42d7-9460-a362886425d6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:01.411455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeaab3-121e-42d7-9460-a362886425d6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:01.412845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 675/1344] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:01.418259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ddda2-9869-4ef9-a8e6-20fe9d7d45f3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:01.418667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ddda2-9869-4ef9-a8e6-20fe9d7d45f3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:01.418804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ddda2-9869-4ef9-a8e6-20fe9d7d45f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:01.486777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-287ddda2-9869-4ef9-a8e6-20fe9d7d45f3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:01.487995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-287ddda2-9869-4ef9-a8e6-20fe9d7d45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:01.507971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:01.593440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 670/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:01.874230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeaab3-121e-42d7-9460-a362886425d6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:01.876168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-93eeaab3-121e-42d7-9460-a362886425d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:01.985819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeaab3-121e-42d7-9460-a362886425d6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:02.066885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:02.067697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:02.068042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:02.068405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:02.070363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:02.119675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:02.186897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:02.188326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6d815-efb0-4b38-9691-7d41ef9ce0dc service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:02.207729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 676/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:06.052107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6048476-acbb-4bd6-bb23-d81f356efa92 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:06.052684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6048476-acbb-4bd6-bb23-d81f356efa92 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:06.052684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6048476-acbb-4bd6-bb23-d81f356efa92 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:06.054078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 671/1347] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:06.059739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51da3b-6405-4693-a234-33dfc8fb9b3d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:06.060492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51da3b-6405-4693-a234-33dfc8fb9b3d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:06.060492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51da3b-6405-4693-a234-33dfc8fb9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:06.134139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6d51da3b-6405-4693-a234-33dfc8fb9b3d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:06.135353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6d51da3b-6405-4693-a234-33dfc8fb9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:06.237158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:06.240441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 677/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:06.520263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6048476-acbb-4bd6-bb23-d81f356efa92 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:06.521981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a6048476-acbb-4bd6-bb23-d81f356efa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:06.630436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6048476-acbb-4bd6-bb23-d81f356efa92 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:06.680544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:06.708048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:06.708668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:06.708975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:06.709245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:06.710853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:06.824344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:06.825817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1681d61-45bb-49db-aafc-027fe857c2f1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:06.843981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 672/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:11.668791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2dd92-1aa5-4123-a77f-2e97a0f05031 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:11.669663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2dd92-1aa5-4123-a77f-2e97a0f05031 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:11.670083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2dd92-1aa5-4123-a77f-2e97a0f05031 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:11.671869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 678/1350] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 03:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:11.678292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dd895-0fdc-469a-b884-92a5862b3804 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:11.678721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dd895-0fdc-469a-b884-92a5862b3804 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:11.678821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24dd895-0fdc-469a-b884-92a5862b3804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:11.775795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a24dd895-0fdc-469a-b884-92a5862b3804 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:11.777471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a24dd895-0fdc-469a-b884-92a5862b3804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:11.799387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:11.951435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 673/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 03:59:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:16.014130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a6e87-e2e6-4a48-8f53-abba66b47b5d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:16.015089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a6e87-e2e6-4a48-8f53-abba66b47b5d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:16.015517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a6e87-e2e6-4a48-8f53-abba66b47b5d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:16.016966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 679/1352] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 03:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:16.021924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4cfc-f3c5-4912-ac64-1f9b4edf2257 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:16.022331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4cfc-f3c5-4912-ac64-1f9b4edf2257 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:16.022545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4cfc-f3c5-4912-ac64-1f9b4edf2257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:16.107635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6abf4cfc-f3c5-4912-ac64-1f9b4edf2257 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:16.109278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6abf4cfc-f3c5-4912-ac64-1f9b4edf2257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:16.184719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:16.223712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 674/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 03:59:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:17.604944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9663-3385-4fb7-815e-eac219361442 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:17.605447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9663-3385-4fb7-815e-eac219361442 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:17.605447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9663-3385-4fb7-815e-eac219361442 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:17.606881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 680/1354] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 03:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:17.611873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aec8f-8803-41c9-8b94-cd3fa56d6be3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:17.612328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aec8f-8803-41c9-8b94-cd3fa56d6be3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:17.612425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aec8f-8803-41c9-8b94-cd3fa56d6be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:17.691475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5a9aec8f-8803-41c9-8b94-cd3fa56d6be3 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:17.692648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5a9aec8f-8803-41c9-8b94-cd3fa56d6be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:17.796726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 675/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 03:59:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:21.070118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fce5-fe8d-4dd7-9953-689bbf5311f2 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:21.070668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fce5-fe8d-4dd7-9953-689bbf5311f2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:21.070668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fce5-fe8d-4dd7-9953-689bbf5311f2 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:21.072050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 681/1356] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:21.077431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bb996-3413-4e14-ba9a-efa5e88eb338 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:21.077891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bb996-3413-4e14-ba9a-efa5e88eb338 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:21.077989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bb996-3413-4e14-ba9a-efa5e88eb338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:21.121161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:21.153812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3f2bb996-3413-4e14-ba9a-efa5e88eb338 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:21.154999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f2bb996-3413-4e14-ba9a-efa5e88eb338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:21.281619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 676/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:21.574126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e097b-9d5f-445b-9864-cdbd2dd0b6cb None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:21.574482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e097b-9d5f-445b-9864-cdbd2dd0b6cb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:21.574677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e097b-9d5f-445b-9864-cdbd2dd0b6cb None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:21.576006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 682/1358] 10.222.0.25 () {54 vars in 962 bytes} [Wed Aug 31 03:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:21.584712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90578caa-f22c-46b9-baee-83fbd597636b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:21.585122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90578caa-f22c-46b9-baee-83fbd597636b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:21.585489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90578caa-f22c-46b9-baee-83fbd597636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:21.668480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-90578caa-f22c-46b9-baee-83fbd597636b None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:21.669693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-90578caa-f22c-46b9-baee-83fbd597636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:21.727391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:21.813642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 677/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Aug 31 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:21.821205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e097b-9d5f-445b-9864-cdbd2dd0b6cb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:21.822727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d01e097b-9d5f-445b-9864-cdbd2dd0b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:21.974185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e097b-9d5f-445b-9864-cdbd2dd0b6cb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:22.055808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:22.100267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:22.101654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:22.101914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:22.102210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:22.104014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:22.199627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:22.201255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34098b-ae65-4216-9707-67218e456ee0 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:22.219440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 683/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:24.341710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144615-e11f-43e8-a86c-536431b9738e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:24.342244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144615-e11f-43e8-a86c-536431b9738e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:24.342381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144615-e11f-43e8-a86c-536431b9738e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:24.343879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 678/1361] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:24.349618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81514-9e5b-46e9-b0a3-c3b0d30bcf0d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:24.350065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81514-9e5b-46e9-b0a3-c3b0d30bcf0d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:24.350176 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81514-9e5b-46e9-b0a3-c3b0d30bcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:24.424150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-12d81514-9e5b-46e9-b0a3-c3b0d30bcf0d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:24.425541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-12d81514-9e5b-46e9-b0a3-c3b0d30bcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:24.466333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:24.540832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 684/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:24.824927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144615-e11f-43e8-a86c-536431b9738e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:24.826537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50144615-e11f-43e8-a86c-536431b9738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:24.983840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144615-e11f-43e8-a86c-536431b9738e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:24.994199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:25.112213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:25.112874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:25.113528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:25.113528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:25.115083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:25.224493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:25.226604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4ef5-6c64-4374-b02c-c27876e2f109 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:25.247108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 679/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:27.455792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017e95-c2a9-4f92-95b5-2c6f57668bc5 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:27.456327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017e95-c2a9-4f92-95b5-2c6f57668bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:27.456422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017e95-c2a9-4f92-95b5-2c6f57668bc5 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:27.457778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 685/1364] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:27.466474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddab73-70c0-4a5e-8248-e418ba5a6024 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:27.466937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddab73-70c0-4a5e-8248-e418ba5a6024 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:27.467032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddab73-70c0-4a5e-8248-e418ba5a6024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:27.483568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:27.538091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4cddab73-70c0-4a5e-8248-e418ba5a6024 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:27.539314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4cddab73-70c0-4a5e-8248-e418ba5a6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:27.644852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 680/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:27.929848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0698-d4d3-4797-a1e3-e40e8c8af98f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:27.930341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0698-d4d3-4797-a1e3-e40e8c8af98f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:27.930782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0698-d4d3-4797-a1e3-e40e8c8af98f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:27.932322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 686/1366] 10.222.0.25 () {54 vars in 962 bytes} [Wed Aug 31 03:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:27.938522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54932-d4f6-4d22-9682-5ec204b773f2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:27.938877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54932-d4f6-4d22-9682-5ec204b773f2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:27.939256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54932-d4f6-4d22-9682-5ec204b773f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:28.021688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-84b54932-d4f6-4d22-9682-5ec204b773f2 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:28.022866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84b54932-d4f6-4d22-9682-5ec204b773f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:28.063101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:28.162927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 681/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Aug 31 03:59:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:28.171341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0698-d4d3-4797-a1e3-e40e8c8af98f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:28.172997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f11c0698-d4d3-4797-a1e3-e40e8c8af98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:28.334997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0698-d4d3-4797-a1e3-e40e8c8af98f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:28.355927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:28.453423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:28.454101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:28.454465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:28.454827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:28.456499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:28.556124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:28.558114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6989ea4-c254-4071-b262-2f7ca38ed1ac service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:28.579136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 687/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:29.125840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cc495-fa05-40e6-910d-73be1ae5700f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:29.126417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cc495-fa05-40e6-910d-73be1ae5700f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:29.126417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cc495-fa05-40e6-910d-73be1ae5700f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:29.127974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 682/1369] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:29.133264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ffbb2-cf9d-476a-921e-0955fe4bb651 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:29.133991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ffbb2-cf9d-476a-921e-0955fe4bb651 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:29.134573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ffbb2-cf9d-476a-921e-0955fe4bb651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:29.171529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:29.214500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9d3ffbb2-cf9d-476a-921e-0955fe4bb651 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:29.216104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9d3ffbb2-cf9d-476a-921e-0955fe4bb651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:29.320709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 688/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:29.902476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eeb89-06b6-4d59-b28c-849149375288 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:29.902741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eeb89-06b6-4d59-b28c-849149375288 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:29.904121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958eeb89-06b6-4d59-b28c-849149375288 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:29.904320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 683/1371] 10.222.0.25 () {54 vars in 964 bytes} [Wed Aug 31 03:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:29.909345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de495a52-761b-4120-8d0e-a9dbd687c702 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:29.909876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de495a52-761b-4120-8d0e-a9dbd687c702 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:29.909876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de495a52-761b-4120-8d0e-a9dbd687c702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:29.993277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-de495a52-761b-4120-8d0e-a9dbd687c702 None None] MFA Rules not processed for user `5557665d603448c3bdeed0b5701e8ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:29.994908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-de495a52-761b-4120-8d0e-a9dbd687c702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:30.044607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:30.080947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 689/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Aug 31 03:59:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:30.088769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eeb89-06b6-4d59-b28c-849149375288 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:30.090329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-958eeb89-06b6-4d59-b28c-849149375288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:30.199723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958eeb89-06b6-4d59-b28c-849149375288 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:30.244643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:30.283052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:30.283822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:30.284180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:30.284482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:30.286460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:30.412888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:30.414277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8757d-22d3-45d9-a194-920292bf4ccc service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:30.438374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 684/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:30.552636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde8ff9-e277-4e99-99f2-973126eff5f0 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:30.553538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde8ff9-e277-4e99-99f2-973126eff5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:30.553990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde8ff9-e277-4e99-99f2-973126eff5f0 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:30.556670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 690/1374] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:30.562995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac323da-2b52-43f6-8553-1f7e149b384a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:30.563783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac323da-2b52-43f6-8553-1f7e149b384a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:30.564309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac323da-2b52-43f6-8553-1f7e149b384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:30.650324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4ac323da-2b52-43f6-8553-1f7e149b384a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:30.651822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4ac323da-2b52-43f6-8553-1f7e149b384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:30.677881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:30.756603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 685/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:31.039385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde8ff9-e277-4e99-99f2-973126eff5f0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:31.041119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8fde8ff9-e277-4e99-99f2-973126eff5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:31.200866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde8ff9-e277-4e99-99f2-973126eff5f0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:31.252717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:31.312904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:31.313460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:31.313736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:31.314002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:31.315609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:31.409227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:31.411784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77dfce-c084-44f5-9e1a-d55e4a994cf9 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:31.431413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 691/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:33.348164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f70d-bd37-4f21-bf9e-b8dde1fdba3f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:33.348622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f70d-bd37-4f21-bf9e-b8dde1fdba3f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:33.348720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f70d-bd37-4f21-bf9e-b8dde1fdba3f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:33.350131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 686/1377] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:33.355789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4a77-34fa-4200-956f-fde8174fbe80 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:33.356217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4a77-34fa-4200-956f-fde8174fbe80 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:33.356414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4a77-34fa-4200-956f-fde8174fbe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:33.425321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0d7e4a77-34fa-4200-956f-fde8174fbe80 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:33.426440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0d7e4a77-34fa-4200-956f-fde8174fbe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:33.438521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:33.540190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 692/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:33.830291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f70d-bd37-4f21-bf9e-b8dde1fdba3f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:33.831879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cda5f70d-bd37-4f21-bf9e-b8dde1fdba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:34.017626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f70d-bd37-4f21-bf9e-b8dde1fdba3f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:34.021842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:34.139141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:34.139934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:34.140300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:34.140659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:34.142370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:34.239216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:34.241013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5845830-a2e8-43fc-8863-e193986df443 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:34.260862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 687/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:36.188840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e6e9-ef18-406b-a7ba-6b90131bcaf6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:36.189361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e6e9-ef18-406b-a7ba-6b90131bcaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:36.189361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e6e9-ef18-406b-a7ba-6b90131bcaf6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:36.194864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 693/1380] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:36.196939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8eb20-625e-4aa5-bebd-b312720f796c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:36.196939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8eb20-625e-4aa5-bebd-b312720f796c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:36.196939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8eb20-625e-4aa5-bebd-b312720f796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:36.208572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:36.267033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7dd8eb20-625e-4aa5-bebd-b312720f796c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:36.268248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7dd8eb20-625e-4aa5-bebd-b312720f796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:36.375021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 688/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:36.673635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e6e9-ef18-406b-a7ba-6b90131bcaf6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:36.675512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3943e6e9-ef18-406b-a7ba-6b90131bcaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:36.829147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:36.840963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e6e9-ef18-406b-a7ba-6b90131bcaf6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:36.960554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:36.961113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:36.961386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:36.961656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:36.963332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:37.057493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:37.059086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7499-2601-4647-bed4-ccca96b9d103 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:37.069883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:37.078696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 694/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:38.996701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9680cc9-2487-4d44-bd93-b1f78aa63bca None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:38.997297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9680cc9-2487-4d44-bd93-b1f78aa63bca None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:38.997563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9680cc9-2487-4d44-bd93-b1f78aa63bca None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:38.999638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 689/1383] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:39.005422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93d5f8-ecba-4b20-b038-d7889ae67a52 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:39.005853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93d5f8-ecba-4b20-b038-d7889ae67a52 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:39.006040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93d5f8-ecba-4b20-b038-d7889ae67a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:39.079243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6e93d5f8-ecba-4b20-b038-d7889ae67a52 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:39.080441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6e93d5f8-ecba-4b20-b038-d7889ae67a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:39.199371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 695/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:39.487563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9680cc9-2487-4d44-bd93-b1f78aa63bca None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:39.489650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b9680cc9-2487-4d44-bd93-b1f78aa63bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:39.600524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:39.665441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9680cc9-2487-4d44-bd93-b1f78aa63bca None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:39.785573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:39.786192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:39.786470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:39.786743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:39.788372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:39.839139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:39.882217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:39.883741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8452fb6-028f-4c1e-a4a0-cb792ba59899 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:39.903209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 690/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:41.773703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f99cf-78d6-46f4-801e-d745fe3d592f None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:41.774261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f99cf-78d6-46f4-801e-d745fe3d592f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:41.774261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f99cf-78d6-46f4-801e-d745fe3d592f None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:41.775667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 696/1386] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:41.781161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40773e5-20b6-4659-8349-8e593379e417 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:41.781616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40773e5-20b6-4659-8349-8e593379e417 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:41.781713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40773e5-20b6-4659-8349-8e593379e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:41.850237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e40773e5-20b6-4659-8349-8e593379e417 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:41.851440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e40773e5-20b6-4659-8349-8e593379e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:41.951414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 691/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:42.234118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f99cf-78d6-46f4-801e-d745fe3d592f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:42.235954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dc4f99cf-78d6-46f4-801e-d745fe3d592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:42.319246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:42.408076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f99cf-78d6-46f4-801e-d745fe3d592f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:42.538716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:42.539507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:42.539790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:42.540063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:42.541858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:42.582726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:42.641052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:42.642653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44afd32-9f35-4692-b2ff-ea052c15e1ae service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:42.661420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 697/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:44.866873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052a2b8-da05-4de2-99c7-6d2871ee9db7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:44.867555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052a2b8-da05-4de2-99c7-6d2871ee9db7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:44.867555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052a2b8-da05-4de2-99c7-6d2871ee9db7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:44.869443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 692/1389] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:44.875725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b497-4b51-4ebd-a822-ed4971cac521 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:44.876166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b497-4b51-4ebd-a822-ed4971cac521 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:44.876262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b497-4b51-4ebd-a822-ed4971cac521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:44.947238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c418b497-4b51-4ebd-a822-ed4971cac521 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:44.948214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c418b497-4b51-4ebd-a822-ed4971cac521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:45.049446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 698/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:45.333741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052a2b8-da05-4de2-99c7-6d2871ee9db7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:45.335296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a052a2b8-da05-4de2-99c7-6d2871ee9db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:45.366091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:45.484502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052a2b8-da05-4de2-99c7-6d2871ee9db7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:45.587151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:45.601241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:45.601840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:45.602121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:45.602389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:45.604045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:45.697112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:45.698815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18574-3ce4-4e2e-9e2b-1f605139fde4 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:45.718007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 693/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:47.106064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71574b-3e05-4e38-85f7-faf6b12d09ce None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.106653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71574b-3e05-4e38-85f7-faf6b12d09ce None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.106653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71574b-3e05-4e38-85f7-faf6b12d09ce None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.108101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 699/1392] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:47.113683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bd6e-5d5d-445f-93d8-0e3ac5978ad8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.114159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bd6e-5d5d-445f-93d8-0e3ac5978ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.114264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bd6e-5d5d-445f-93d8-0e3ac5978ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.186660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-81c8bd6e-5d5d-445f-93d8-0e3ac5978ad8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:47.187966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-81c8bd6e-5d5d-445f-93d8-0e3ac5978ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:47.252405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:47.290574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 694/1393] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:47.584260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e494-cbb1-4582-ab31-e07df7f287e0 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.584551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e494-cbb1-4582-ab31-e07df7f287e0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.584834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e494-cbb1-4582-ab31-e07df7f287e0 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.586233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 700/1394] 10.222.0.25 () {54 vars in 967 bytes} [Wed Aug 31 03:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:47.591342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.591654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.591922 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.633785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8a58-2852-4258-9ec8-796bf033f26a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.634045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8a58-2852-4258-9ec8-796bf033f26a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.634322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8a58-2852-4258-9ec8-796bf033f26a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.635708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 701/1395] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 03:59:47.640780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.641071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.641342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.661529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:47.676688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] MFA Rules not processed for user `e43f4bd3ff65424eb02b4261d3c3d700`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:47.677963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:47.723133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:47.724351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:47.760561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 695/1396] 10.222.0.25 () {58 vars in 1064 bytes} [Wed Aug 31 03:59:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:47.768328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:47.775608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177f7d-a722-4902-a1f7-50af81d13287 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:47.825348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 702/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:47.829662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:47.852593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:47.853252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:47.853540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:47.853808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:47.855395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:47.966042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:47.967478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e8023-4808-43a8-8ed4-f06442f44d87 service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:47.986876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 696/1398] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:59:48.112675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:48.114068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:48.206810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:48.238180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f484bb0-4e89-40f7-a045-a0d0009fbbaf None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:48.373136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:48.373762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:48.374041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:48.374738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:48.376479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:48.473427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:48.475940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:48.477964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f6d6e-b217-4832-b9b1-53c3b5587c8b service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:48.503039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 703/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:48.762760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517f4ef-a3df-42aa-92d4-8349175d4503 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:48.763255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517f4ef-a3df-42aa-92d4-8349175d4503 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:48.763344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517f4ef-a3df-42aa-92d4-8349175d4503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:48.829914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7517f4ef-a3df-42aa-92d4-8349175d4503 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:48.831156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7517f4ef-a3df-42aa-92d4-8349175d4503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:48.867246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:48.919983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 697/1400] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 03:59:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:48.961877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be604d14-d851-43c2-95b1-7f499915a1ad None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:48.962157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be604d14-d851-43c2-95b1-7f499915a1ad None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:48.962424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be604d14-d851-43c2-95b1-7f499915a1ad None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:48.964081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 704/1401] 10.222.0.25 () {54 vars in 943 bytes} [Wed Aug 31 03:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:48.970903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e228a-2284-4268-bd97-ce87c4b4eef4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:48.971207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e228a-2284-4268-bd97-ce87c4b4eef4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:48.971483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e228a-2284-4268-bd97-ce87c4b4eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:49.053479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1d5e228a-2284-4268-bd97-ce87c4b4eef4 None None] MFA Rules not processed for user `844c5874363b4611b64c3ffa2dc1033c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:49.054697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d5e228a-2284-4268-bd97-ce87c4b4eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:49.165569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 698/1402] 10.222.0.25 () {58 vars in 1040 bytes} [Wed Aug 31 03:59:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:49.174840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be604d14-d851-43c2-95b1-7f499915a1ad None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:49.176402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-be604d14-d851-43c2-95b1-7f499915a1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:49.311996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be604d14-d851-43c2-95b1-7f499915a1ad None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:49.384771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:49.417681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:49.418289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:49.418564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:49.418825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:49.420430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:49.502794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:49.504466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f1f7f-8640-4b4a-ac2e-90fee1cc0fc6 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:49.512852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 705/1403] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 03:59:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:59:50.443263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679481-2b8d-4f9c-a79d-fe5fe503b83d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:50.443851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679481-2b8d-4f9c-a79d-fe5fe503b83d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:50.443851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679481-2b8d-4f9c-a79d-fe5fe503b83d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:50.450207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 699/1404] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:50.451894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3cf3-60d2-4776-9f0d-b76ed149078d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:50.452315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3cf3-60d2-4776-9f0d-b76ed149078d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:50.452492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc3cf3-60d2-4776-9f0d-b76ed149078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:50.524097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-04fc3cf3-60d2-4776-9f0d-b76ed149078d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:50.525375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-04fc3cf3-60d2-4776-9f0d-b76ed149078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:50.591442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:50.635905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 706/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:59:50.928390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c679481-2b8d-4f9c-a79d-fe5fe503b83d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:50.930138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8c679481-2b8d-4f9c-a79d-fe5fe503b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:50.941154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:51.133540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c679481-2b8d-4f9c-a79d-fe5fe503b83d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:51.220669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:51.260418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:51.261090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:51.261372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:51.261643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:51.263268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:51.358609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:51.360333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fda299-5c0e-47e0-ab27-6d51c75cc622 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:51.378984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 700/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:59:53.348544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f396eb-b5f8-4e1d-b0d5-df7e30241751 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:53.349175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f396eb-b5f8-4e1d-b0d5-df7e30241751 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:53.349175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f396eb-b5f8-4e1d-b0d5-df7e30241751 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:53.350447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 707/1407] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 03:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:59:53.355735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d2b0-ef0a-4604-9547-161296bf6640 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:53.356384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d2b0-ef0a-4604-9547-161296bf6640 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:53.356384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d2b0-ef0a-4604-9547-161296bf6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:53.428414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1d11d2b0-ef0a-4604-9547-161296bf6640 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:59:53.429711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d11d2b0-ef0a-4604-9547-161296bf6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:53.479086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:53.544724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 701/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 03:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:59:53.829906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f396eb-b5f8-4e1d-b0d5-df7e30241751 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:59:53.831623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-93f396eb-b5f8-4e1d-b0d5-df7e30241751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:53.998490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f396eb-b5f8-4e1d-b0d5-df7e30241751 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:59:54.053636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 03:59:54.127827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:59:54.132095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:59:54.132095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:59:54.132095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:59:54.132095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:59:54.234458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:59:54.236464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cc6e1-91f1-4515-97af-596d32a8e610 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:59:54.256148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 708/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 03:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:03.542628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=24 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:04.253345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=78 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:11.273778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29941c24-4921-43f6-af25-1d55fde7fb8c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:11.274372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29941c24-4921-43f6-af25-1d55fde7fb8c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:11.274372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29941c24-4921-43f6-af25-1d55fde7fb8c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:11.275690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 702/1410] 10.222.0.25 () {54 vars in 918 bytes} [Wed Aug 31 04:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:11.281396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40006f-c4fa-4f47-95b3-05e2e7820e90 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:11.281816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40006f-c4fa-4f47-95b3-05e2e7820e90 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:11.281974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40006f-c4fa-4f47-95b3-05e2e7820e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:11.359662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4d40006f-c4fa-4f47-95b3-05e2e7820e90 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:11.360890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4d40006f-c4fa-4f47-95b3-05e2e7820e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:11.473302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Aug 31 04:00:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:11.488347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998b3b-5f8a-420a-9b22-57b011c1d736 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:11.488725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998b3b-5f8a-420a-9b22-57b011c1d736 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:11.489052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998b3b-5f8a-420a-9b22-57b011c1d736 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:11.490409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 703/1412] 10.222.0.25 () {54 vars in 918 bytes} [Wed Aug 31 04:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:11.495224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9610-6f9d-4079-883f-03e318d5a13d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:11.495536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9610-6f9d-4079-883f-03e318d5a13d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:11.495807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9610-6f9d-4079-883f-03e318d5a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:11.579571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:11.582578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2d9f9610-6f9d-4079-883f-03e318d5a13d None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:11.584441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d9f9610-6f9d-4079-883f-03e318d5a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:11.706094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Aug 31 04:00:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:14.073556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099376-7e05-4a1f-ba8e-f85f884c8b00 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:14.074138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099376-7e05-4a1f-ba8e-f85f884c8b00 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:14.074138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099376-7e05-4a1f-ba8e-f85f884c8b00 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:14.075412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:14.081780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd2284-bc5a-4233-bdd8-043649776015 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:14.082439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd2284-bc5a-4233-bdd8-043649776015 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:14.082621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd2284-bc5a-4233-bdd8-043649776015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:14.158285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3edd2284-bc5a-4233-bdd8-043649776015 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:14.159484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3edd2284-bc5a-4233-bdd8-043649776015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:14.214807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:14.267424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:14.554274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099376-7e05-4a1f-ba8e-f85f884c8b00 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:14.555838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ee099376-7e05-4a1f-ba8e-f85f884c8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:14.739036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099376-7e05-4a1f-ba8e-f85f884c8b00 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:14.836876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:14.883655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:14.884293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:14.884571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:14.884836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:14.886536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:14.982450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:14.984056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218074d-a766-44bd-be98-5aa1f68a49c7 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:15.004338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 705/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:15.898474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26418d25-49ac-4cef-b25b-714eea445ad9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:15.899363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26418d25-49ac-4cef-b25b-714eea445ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:15.899363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26418d25-49ac-4cef-b25b-714eea445ad9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:15.901032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:15.906319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb1d4b-5b2a-4c6a-8322-035347018017 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:15.906757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb1d4b-5b2a-4c6a-8322-035347018017 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:15.906883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb1d4b-5b2a-4c6a-8322-035347018017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:15.990665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-76fb1d4b-5b2a-4c6a-8322-035347018017 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:15.991788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-76fb1d4b-5b2a-4c6a-8322-035347018017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:16.020310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:16.101731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:16.255917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26418d25-49ac-4cef-b25b-714eea445ad9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:16.258419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-26418d25-49ac-4cef-b25b-714eea445ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:16.419330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26418d25-49ac-4cef-b25b-714eea445ad9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:16.460100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:16.548458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:16.549029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:16.549308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:16.549579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:16.551203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:16.649856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:16.651478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b458a-4bee-4f81-a4bb-d27ce064b627 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:16.670570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 713/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:17.554034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafe750-a697-4c0c-8e34-f34b8795e832 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:17.554624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafe750-a697-4c0c-8e34-f34b8795e832 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:17.554624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafe750-a697-4c0c-8e34-f34b8795e832 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:17.555940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:17.561089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218de57-0aa9-4a93-9193-395987e7d348 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:17.561505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218de57-0aa9-4a93-9193-395987e7d348 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:17.561616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218de57-0aa9-4a93-9193-395987e7d348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:17.630385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:17.654368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c218de57-0aa9-4a93-9193-395987e7d348 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:17.655567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c218de57-0aa9-4a93-9193-395987e7d348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:17.761991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:17.911982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafe750-a697-4c0c-8e34-f34b8795e832 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:17.914369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-afafe750-a697-4c0c-8e34-f34b8795e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:18.077151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafe750-a697-4c0c-8e34-f34b8795e832 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:18.090057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:18.197066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:18.197591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:18.197859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:18.198126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:18.199746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:18.291634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:18.293286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd8115-8496-49c3-81cf-21afb78eaff5 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:18.311530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 708/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:19.165152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ac5c-e29f-48ea-a029-cab07db7ca99 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:19.165790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ac5c-e29f-48ea-a029-cab07db7ca99 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:19.165790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ac5c-e29f-48ea-a029-cab07db7ca99 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:19.167053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:19.173237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb0726-1a0a-4834-b3e3-a7b5d7ce7d72 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:19.174008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb0726-1a0a-4834-b3e3-a7b5d7ce7d72 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:19.174162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb0726-1a0a-4834-b3e3-a7b5d7ce7d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:19.203154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:19.264610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bacb0726-1a0a-4834-b3e3-a7b5d7ce7d72 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:19.265834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bacb0726-1a0a-4834-b3e3-a7b5d7ce7d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:19.373432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:19.535861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ac5c-e29f-48ea-a029-cab07db7ca99 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:19.538414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b0d9ac5c-e29f-48ea-a029-cab07db7ca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:19.662290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:19.700157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ac5c-e29f-48ea-a029-cab07db7ca99 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:19.817813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:19.818336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:19.818611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:19.818880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:19.820486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:19.903613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:19.921915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:19.923531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43498355-8bfc-49af-a343-3e8c0952932e service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:19.941909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 716/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:20.792540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f05ee-4a3d-4788-9d83-a2280f382a50 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:20.793379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f05ee-4a3d-4788-9d83-a2280f382a50 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:20.793379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f05ee-4a3d-4788-9d83-a2280f382a50 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:20.795662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:20.804098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9e0f-6780-41c2-9c17-da26d35eebcc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:20.804534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9e0f-6780-41c2-9c17-da26d35eebcc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:20.804683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9e0f-6780-41c2-9c17-da26d35eebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:20.889095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cc8c9e0f-6780-41c2-9c17-da26d35eebcc None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:20.890333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cc8c9e0f-6780-41c2-9c17-da26d35eebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:20.997878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:21.153571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f05ee-4a3d-4788-9d83-a2280f382a50 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:21.155116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-176f05ee-4a3d-4788-9d83-a2280f382a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:21.254769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:21.321232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f05ee-4a3d-4788-9d83-a2280f382a50 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:21.450040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:21.450661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:21.450939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:21.451209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:21.452993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:21.505665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:21.550271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:21.551895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc46d9e-0704-404e-987b-5853806d8311 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:21.570544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 711/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:22.384047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da66a7-2853-42a5-bfad-da834b7757f6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:22.385103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da66a7-2853-42a5-bfad-da834b7757f6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:22.385103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da66a7-2853-42a5-bfad-da834b7757f6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:22.387198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:22.392381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea1ed-e482-43ff-b80b-7de96668bfa7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:22.392882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea1ed-e482-43ff-b80b-7de96668bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:22.392987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea1ed-e482-43ff-b80b-7de96668bfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:22.475698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c3fea1ed-e482-43ff-b80b-7de96668bfa7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:22.476987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3fea1ed-e482-43ff-b80b-7de96668bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:22.590538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:22.749767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da66a7-2853-42a5-bfad-da834b7757f6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:22.751323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47da66a7-2853-42a5-bfad-da834b7757f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:22.808792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:22.907731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da66a7-2853-42a5-bfad-da834b7757f6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:23.030144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:23.030758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:23.031039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:23.031312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:23.032969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:23.040086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:23.126481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:23.128093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17505b27-beff-4f53-929e-8b559fd5b19f service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:23.145838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 719/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:23.948378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30de4b-e227-4fe9-a4df-2e102e391dab None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:23.948982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30de4b-e227-4fe9-a4df-2e102e391dab None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:23.948982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30de4b-e227-4fe9-a4df-2e102e391dab None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:23.950799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:23.955972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e09a5-e9aa-411b-97b9-7e0f474025aa None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:23.956396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e09a5-e9aa-411b-97b9-7e0f474025aa None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:23.956589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e09a5-e9aa-411b-97b9-7e0f474025aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:24.036793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-687e09a5-e9aa-411b-97b9-7e0f474025aa None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:24.038014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-687e09a5-e9aa-411b-97b9-7e0f474025aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:24.118822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:24.151565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:24.303123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30de4b-e227-4fe9-a4df-2e102e391dab None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:24.304675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fa30de4b-e227-4fe9-a4df-2e102e391dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:24.323579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:24.465557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30de4b-e227-4fe9-a4df-2e102e391dab None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:24.569791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:24.608597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:24.609235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:24.609518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:24.609787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:24.611396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:24.702555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:24.704215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975f75-b5df-4841-b73c-24750e3a4511 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:24.722656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 714/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:25.533282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca646-1056-4f3b-8af4-7665b01eb760 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:25.533990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca646-1056-4f3b-8af4-7665b01eb760 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:25.533990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ca646-1056-4f3b-8af4-7665b01eb760 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:25.535783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:25.543821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730080d-525a-41f3-861c-ff91750dd10d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:25.544431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730080d-525a-41f3-861c-ff91750dd10d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:25.544680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730080d-525a-41f3-861c-ff91750dd10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:25.631648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9730080d-525a-41f3-861c-ff91750dd10d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:25.632836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9730080d-525a-41f3-861c-ff91750dd10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:25.675160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:25.734298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:25.888152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca646-1056-4f3b-8af4-7665b01eb760 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:25.889771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eb6ca646-1056-4f3b-8af4-7665b01eb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:26.044598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ca646-1056-4f3b-8af4-7665b01eb760 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:26.101362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:26.164838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:26.165480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:26.165785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:26.166049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:26.167646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:26.261339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:26.262909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34262f-4752-4aeb-9bfb-8026c5bea992 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:26.280792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 722/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:27.079822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522cb6-570f-4a7d-bdb1-3ebefdd1b2a7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:27.080713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522cb6-570f-4a7d-bdb1-3ebefdd1b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:27.080713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d522cb6-570f-4a7d-bdb1-3ebefdd1b2a7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:27.082963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:00:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:27.088471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a61e29-91e2-493f-a5f6-392f95a1c10f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:27.088921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a61e29-91e2-493f-a5f6-392f95a1c10f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:27.089055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a61e29-91e2-493f-a5f6-392f95a1c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:27.169986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e7a61e29-91e2-493f-a5f6-392f95a1c10f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:27.171184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e7a61e29-91e2-493f-a5f6-392f95a1c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:27.173328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:27.273215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:27.427321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522cb6-570f-4a7d-bdb1-3ebefdd1b2a7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:27.429275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9d522cb6-570f-4a7d-bdb1-3ebefdd1b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:27.582178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d522cb6-570f-4a7d-bdb1-3ebefdd1b2a7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:27.610300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:27.700739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:27.701410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:27.701684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:27.701956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:27.703565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:27.795139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:27.796820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677721de-fe4c-471d-9bdb-32d95def1b75 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:27.815781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 717/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:29.636573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59552-8842-4136-a1d2-54a53511f76c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:29.637171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59552-8842-4136-a1d2-54a53511f76c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:29.637171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59552-8842-4136-a1d2-54a53511f76c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:29.638417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:29.644906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939972a-28e5-42e9-b04f-185e92f10dd0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:29.645613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939972a-28e5-42e9-b04f-185e92f10dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:29.645906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939972a-28e5-42e9-b04f-185e92f10dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:29.695235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:29.723410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b939972a-28e5-42e9-b04f-185e92f10dd0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:29.724633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b939972a-28e5-42e9-b04f-185e92f10dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:29.827147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:30.109222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b59552-8842-4136-a1d2-54a53511f76c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:30.111577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-17b59552-8842-4136-a1d2-54a53511f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:30.238773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b59552-8842-4136-a1d2-54a53511f76c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:30.271394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:30.314430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:30.315029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:30.315302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:30.315572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:30.317202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:30.430043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:30.431450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddec294-5137-4a39-a9c2-291355ac8326 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:30.449806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 725/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:32.525050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5918aa-abf5-41ed-8053-fb7ff39208a0 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:32.525667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5918aa-abf5-41ed-8053-fb7ff39208a0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:32.525667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5918aa-abf5-41ed-8053-fb7ff39208a0 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:32.526946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:32.533504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99461a-a4c5-448d-8d65-7e8b66215037 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:32.534232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99461a-a4c5-448d-8d65-7e8b66215037 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:32.534412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99461a-a4c5-448d-8d65-7e8b66215037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:32.608090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fa99461a-a4c5-448d-8d65-7e8b66215037 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:32.609342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fa99461a-a4c5-448d-8d65-7e8b66215037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:32.623252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:32.710185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:32.986560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5918aa-abf5-41ed-8053-fb7ff39208a0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:32.988132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4f5918aa-abf5-41ed-8053-fb7ff39208a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:33.098850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5918aa-abf5-41ed-8053-fb7ff39208a0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:33.111262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:33.185016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:33.185670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:33.185906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:33.186202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:33.187807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:33.312856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:33.314332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc7820-aef9-4100-aa7b-ad3f6f9ef277 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:33.332472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 720/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:35.618543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff268b-b681-4be9-b339-4b4380167212 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:35.619091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff268b-b681-4be9-b339-4b4380167212 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:35.619091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff268b-b681-4be9-b339-4b4380167212 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:35.620363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:35.626388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a4dea-3d26-4e53-977b-6c7075fa6940 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:35.626848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a4dea-3d26-4e53-977b-6c7075fa6940 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:35.626941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a4dea-3d26-4e53-977b-6c7075fa6940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:35.676670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:35.696172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ce5a4dea-3d26-4e53-977b-6c7075fa6940 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:35.697525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ce5a4dea-3d26-4e53-977b-6c7075fa6940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:35.803769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:36.087794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff268b-b681-4be9-b339-4b4380167212 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:36.089430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-28ff268b-b681-4be9-b339-4b4380167212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:36.206970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff268b-b681-4be9-b339-4b4380167212 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:36.248015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:36.282745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:36.283355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:36.283627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:36.283892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:36.285537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:36.405388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:36.406751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e35a0-8870-4bc5-b8db-b5dc815362d8 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:36.426305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 728/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:38.468605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72d1f-be9f-4fd0-8bfc-fa266c83c345 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:38.469229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72d1f-be9f-4fd0-8bfc-fa266c83c345 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:38.469229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72d1f-be9f-4fd0-8bfc-fa266c83c345 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:38.470569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:38.475985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b664-dff1-4e1e-bf7f-138ef8cc7569 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:38.476460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b664-dff1-4e1e-bf7f-138ef8cc7569 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:38.476567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b664-dff1-4e1e-bf7f-138ef8cc7569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:38.545464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2fe8b664-dff1-4e1e-bf7f-138ef8cc7569 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:38.546661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2fe8b664-dff1-4e1e-bf7f-138ef8cc7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:38.567528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:38.644746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:38.922487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72d1f-be9f-4fd0-8bfc-fa266c83c345 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:38.924073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9da72d1f-be9f-4fd0-8bfc-fa266c83c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:39.032054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72d1f-be9f-4fd0-8bfc-fa266c83c345 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:39.052332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:39.108417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:39.109050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:39.109323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:39.109591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:39.111170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:39.223785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:39.225178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecca02-6844-4006-9975-f1a336c33706 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:39.243299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 723/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:41.212553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9cce-6b2a-4a47-92bf-cfe8fde6b1e6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:41.213484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9cce-6b2a-4a47-92bf-cfe8fde6b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:41.213484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9cce-6b2a-4a47-92bf-cfe8fde6b1e6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:41.215633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:41.222104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367086e6-42f3-4f71-98cf-c2043efb1bd4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:41.222545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367086e6-42f3-4f71-98cf-c2043efb1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:41.222666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367086e6-42f3-4f71-98cf-c2043efb1bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:41.296111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:41.299018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-367086e6-42f3-4f71-98cf-c2043efb1bd4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:41.300903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-367086e6-42f3-4f71-98cf-c2043efb1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:41.406165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:41.693003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9cce-6b2a-4a47-92bf-cfe8fde6b1e6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:41.694650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cd7f9cce-6b2a-4a47-92bf-cfe8fde6b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:41.800448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9cce-6b2a-4a47-92bf-cfe8fde6b1e6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:41.849413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:41.874192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:41.875139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:41.875419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:41.875689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:41.877337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:42.001898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:42.003248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca4cdf-51dc-4232-971b-52fba36d0ba5 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:42.022378 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 731/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:00:43.964258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62243-df4b-4d74-9c8e-88ddc63e30f6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:43.965180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62243-df4b-4d74-9c8e-88ddc63e30f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:43.965180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62243-df4b-4d74-9c8e-88ddc63e30f6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:43.967206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:43.972770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b5fe7-b83a-4ac5-bc65-602dd3ad993a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:43.973218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b5fe7-b83a-4ac5-bc65-602dd3ad993a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:43.973313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b5fe7-b83a-4ac5-bc65-602dd3ad993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:44.041741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6b9b5fe7-b83a-4ac5-bc65-602dd3ad993a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:44.042948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6b9b5fe7-b83a-4ac5-bc65-602dd3ad993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:44.074258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:44.145993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:44.427658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62243-df4b-4d74-9c8e-88ddc63e30f6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:44.430180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9ad62243-df4b-4d74-9c8e-88ddc63e30f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:44.540824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62243-df4b-4d74-9c8e-88ddc63e30f6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:44.580656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:44.634147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:44.634760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:44.635042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:44.635312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:44.636956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:44.756507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:44.758023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571256fe-8bd8-4cdb-b74c-bedd950b5463 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:44.776565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 726/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:46.708655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf70ec-63ec-4b3f-a6f8-0c8bebc03ced None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:46.709209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf70ec-63ec-4b3f-a6f8-0c8bebc03ced None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:46.709209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf70ec-63ec-4b3f-a6f8-0c8bebc03ced None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:46.710597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:46.716389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a53a50-6d64-44af-b6f8-57dc73eea8f5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:46.716862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a53a50-6d64-44af-b6f8-57dc73eea8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:46.716974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a53a50-6d64-44af-b6f8-57dc73eea8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:46.786577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-04a53a50-6d64-44af-b6f8-57dc73eea8f5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:46.787797 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-04a53a50-6d64-44af-b6f8-57dc73eea8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:46.796345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:46.889576 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:47.180238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf70ec-63ec-4b3f-a6f8-0c8bebc03ced None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:47.181986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-accf70ec-63ec-4b3f-a6f8-0c8bebc03ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:47.295219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf70ec-63ec-4b3f-a6f8-0c8bebc03ced None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:47.352331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:47.371606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:47.372215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:47.372466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:47.372767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:47.374398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:47.498034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:47.500128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746590a4-a202-402d-8a3b-d7fc9973bac6 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:47.519419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 734/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:49.463711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb78a4-b4c7-4942-b02e-622afb5fa28a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:49.464313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb78a4-b4c7-4942-b02e-622afb5fa28a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:49.464313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb78a4-b4c7-4942-b02e-622afb5fa28a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:49.466564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:49.472723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d0831-5ef3-4e7e-9242-c730fe30abf9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:49.473482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d0831-5ef3-4e7e-9242-c730fe30abf9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:49.473638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d0831-5ef3-4e7e-9242-c730fe30abf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:49.674629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1b4d0831-5ef3-4e7e-9242-c730fe30abf9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:49.675733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1b4d0831-5ef3-4e7e-9242-c730fe30abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:49.717599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:49.777107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:50.056038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb78a4-b4c7-4942-b02e-622afb5fa28a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:50.058683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-10eb78a4-b4c7-4942-b02e-622afb5fa28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:50.186918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb78a4-b4c7-4942-b02e-622afb5fa28a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:50.224715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:50.261989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:50.262600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:50.262867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:50.263157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:50.264720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:50.388735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:50.390135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0838df7-d241-4028-a149-9715f26243fb service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:50.408788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 729/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:52.307738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4f78-0002-4f75-9bde-3ae07f0f9c29 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:52.308302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4f78-0002-4f75-9bde-3ae07f0f9c29 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:52.308302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4f78-0002-4f75-9bde-3ae07f0f9c29 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:52.309645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:52.316178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd942-e43d-4016-aa1e-abd4af65dcaf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:52.316636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd942-e43d-4016-aa1e-abd4af65dcaf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:52.316736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd942-e43d-4016-aa1e-abd4af65dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:52.387247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-117fd942-e43d-4016-aa1e-abd4af65dcaf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:52.389124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-117fd942-e43d-4016-aa1e-abd4af65dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:52.412775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:52.494615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:52.780691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4f78-0002-4f75-9bde-3ae07f0f9c29 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:52.783081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1eeb4f78-0002-4f75-9bde-3ae07f0f9c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:52.903746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4f78-0002-4f75-9bde-3ae07f0f9c29 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:52.976932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:52.985261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:52.985880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:52.986156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:52.986423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:52.988034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:53.099323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:53.100745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff87222-5ee2-43f1-bb63-419e4f799e5e service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:53.119090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 737/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:00:55.074352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9114-00a0-4bdf-98de-489c475a25f6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:55.074937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9114-00a0-4bdf-98de-489c475a25f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:55.074937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea9114-00a0-4bdf-98de-489c475a25f6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:55.077000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:00:55.085543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7512-9e8e-4fc8-9fcc-6ab31895ee01 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:55.085968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7512-9e8e-4fc8-9fcc-6ab31895ee01 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:55.086103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7512-9e8e-4fc8-9fcc-6ab31895ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:55.159751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0bbd7512-9e8e-4fc8-9fcc-6ab31895ee01 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:00:55.161054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0bbd7512-9e8e-4fc8-9fcc-6ab31895ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:55.211467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:55.265883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:00:55.557846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9114-00a0-4bdf-98de-489c475a25f6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:00:55.560319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0cea9114-00a0-4bdf-98de-489c475a25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:55.693804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea9114-00a0-4bdf-98de-489c475a25f6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:00:55.744287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:00:55.776574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:00:55.777240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:00:55.777490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:00:55.777758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:00:55.779363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:00:55.908349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:00:55.909879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f8ef9-c77e-4d4e-877a-42d64726f38e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:00:55.928876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 732/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:05.262468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=22 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:05.926397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=66 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:15.275476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188e1f7-bba3-4b3a-93a6-935da9f46ea6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:15.276313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188e1f7-bba3-4b3a-93a6-935da9f46ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:15.276313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188e1f7-bba3-4b3a-93a6-935da9f46ea6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:15.278498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 739/1471] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:01:15.287217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c07d-4150-4dd2-8223-4e8e0e02806d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:15.287663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c07d-4150-4dd2-8223-4e8e0e02806d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:15.287769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c07d-4150-4dd2-8223-4e8e0e02806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:15.360065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c077c07d-4150-4dd2-8223-4e8e0e02806d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:15.361284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c077c07d-4150-4dd2-8223-4e8e0e02806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:15.462755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 733/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:01:15.756155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0cc5-af52-4c0b-981d-3031024e6134 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:15.756487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0cc5-af52-4c0b-981d-3031024e6134 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:15.756864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0cc5-af52-4c0b-981d-3031024e6134 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:15.759036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 740/1473] 10.222.0.25 () {54 vars in 967 bytes} [Wed Aug 31 04:01:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:15.764060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d2f81-ae20-4a74-a3e7-945b2d9aa9a7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:15.764346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d2f81-ae20-4a74-a3e7-945b2d9aa9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:15.764652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d2f81-ae20-4a74-a3e7-945b2d9aa9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:15.845079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7b9d2f81-ae20-4a74-a3e7-945b2d9aa9a7 None None] MFA Rules not processed for user `e43f4bd3ff65424eb02b4261d3c3d700`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:15.846293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7b9d2f81-ae20-4a74-a3e7-945b2d9aa9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:15.868060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:15.932987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 734/1474] 10.222.0.25 () {58 vars in 1064 bytes} [Wed Aug 31 04:01:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:01:15.940779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a0cc5-af52-4c0b-981d-3031024e6134 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:15.942325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1e5a0cc5-af52-4c0b-981d-3031024e6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:16.057358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a0cc5-af52-4c0b-981d-3031024e6134 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:16.133911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:16.134513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:16.134781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:16.135041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:16.136628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:16.191615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:16.247251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:16.248678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613228e7-cef5-4735-94e8-c7dd98dfed9e service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:16.267547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 741/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:18.241780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe546-160d-4d86-87eb-36de29587d17 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:18.242428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe546-160d-4d86-87eb-36de29587d17 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:18.242531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefe546-160d-4d86-87eb-36de29587d17 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:18.243893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 735/1476] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:18.252860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f710b2-927d-4e55-86c5-b77a1992f686 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:18.253575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f710b2-927d-4e55-86c5-b77a1992f686 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:18.253749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f710b2-927d-4e55-86c5-b77a1992f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:18.325723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-18f710b2-927d-4e55-86c5-b77a1992f686 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:18.326935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-18f710b2-927d-4e55-86c5-b77a1992f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:18.432339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 742/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:01:18.701966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe546-160d-4d86-87eb-36de29587d17 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:18.703561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9cefe546-160d-4d86-87eb-36de29587d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:18.843707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefe546-160d-4d86-87eb-36de29587d17 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:18.897121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:18.946003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:18.946551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:18.946829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:18.947099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:18.947743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:18.949596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:01:18.949596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:01:18.949596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:01:18.950754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734663cd-7226-4e8b-a97f-af5a40095a8e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:18.969783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 736/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Aug 31 04:01:18 2022] GET /identity/v3/projects => generated 2553 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:01:20.876669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd6c64-b381-486a-888a-e856e6fe96a3 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:20.877316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd6c64-b381-486a-888a-e856e6fe96a3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:20.877316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd6c64-b381-486a-888a-e856e6fe96a3 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:20.879232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 743/1479] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:20.884537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9336ffe-f9d1-4230-9fed-fa258df4a8b7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:20.885008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9336ffe-f9d1-4230-9fed-fa258df4a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:20.885138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9336ffe-f9d1-4230-9fed-fa258df4a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:20.955425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a9336ffe-f9d1-4230-9fed-fa258df4a8b7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:20.956597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9336ffe-f9d1-4230-9fed-fa258df4a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:21.054924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:01:21.354439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd6c64-b381-486a-888a-e856e6fe96a3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:21.355945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0acd6c64-b381-486a-888a-e856e6fe96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:21.369294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:21.524381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd6c64-b381-486a-888a-e856e6fe96a3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:21.614498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:21.650301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:21.650930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:21.651250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:21.651513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:21.653192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:21.766344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:21.767932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b33be-7e31-408e-8188-d5d4acf0a2b4 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:21.785907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 744/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:23.863341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c227-ac43-4a8b-b8c3-a6ec3de0f947 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:23.863959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c227-ac43-4a8b-b8c3-a6ec3de0f947 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:23.863959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c227-ac43-4a8b-b8c3-a6ec3de0f947 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:23.865282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 738/1482] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:23.870913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0503-3d19-4955-bd5f-c8e303812d4d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:23.871368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0503-3d19-4955-bd5f-c8e303812d4d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:23.871474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0503-3d19-4955-bd5f-c8e303812d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:23.946929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8d6d0503-3d19-4955-bd5f-c8e303812d4d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:23.948052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8d6d0503-3d19-4955-bd5f-c8e303812d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:24.009447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:24.067210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:01:24.356315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381c227-ac43-4a8b-b8c3-a6ec3de0f947 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:24.358786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a381c227-ac43-4a8b-b8c3-a6ec3de0f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:24.394332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:24.481411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381c227-ac43-4a8b-b8c3-a6ec3de0f947 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:24.559583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:24.560133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:24.560408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:24.560678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:24.562324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:24.639224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:24.681227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:24.682676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54eb5e-195b-4675-884c-1c41b48988e9 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:24.702248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 739/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:26.639046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870486-b97c-45fa-a0d6-d564865de85e None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:26.639591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870486-b97c-45fa-a0d6-d564865de85e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:26.639591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870486-b97c-45fa-a0d6-d564865de85e None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:26.640843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 746/1485] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:26.648908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f41e-da17-4128-a9b0-26f4cbd9c462 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:26.649401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f41e-da17-4128-a9b0-26f4cbd9c462 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:26.649401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534f41e-da17-4128-a9b0-26f4cbd9c462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:26.729919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8534f41e-da17-4128-a9b0-26f4cbd9c462 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:26.731226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8534f41e-da17-4128-a9b0-26f4cbd9c462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:26.838076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 740/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:01:27.121620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870486-b97c-45fa-a0d6-d564865de85e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:27.123971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-21870486-b97c-45fa-a0d6-d564865de85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:27.236697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870486-b97c-45fa-a0d6-d564865de85e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:27.316203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:27.318846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:27.319493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:27.319794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:27.320047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:27.322674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:27.436561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:27.438075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488b19f-5a17-4d86-a9be-3c3fa4c0f4e0 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:27.456006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 747/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:29.491079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10cf8-bfa5-4484-a860-f2d00438a89d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:29.491681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10cf8-bfa5-4484-a860-f2d00438a89d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:29.491681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10cf8-bfa5-4484-a860-f2d00438a89d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:29.493039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 741/1488] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:29.499516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0dc31-1628-421a-988e-a8d72af0a4f5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:29.500581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0dc31-1628-421a-988e-a8d72af0a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:29.500786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0dc31-1628-421a-988e-a8d72af0a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:29.572632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-53b0dc31-1628-421a-988e-a8d72af0a4f5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:29.573857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-53b0dc31-1628-421a-988e-a8d72af0a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:29.634041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:29.681581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 748/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:01:29.974295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10cf8-bfa5-4484-a860-f2d00438a89d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:29.976789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9a10cf8-bfa5-4484-a860-f2d00438a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:30.018881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:30.088187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10cf8-bfa5-4484-a860-f2d00438a89d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:30.166511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:30.167133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:30.167408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:30.167675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:30.169351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:30.255928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:30.290027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:30.291478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2563f25-ae33-4e6a-a66e-1206adeb69eb service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:30.310150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 742/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:32.401611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe566-5ca5-40e0-94fa-40c5ba849e55 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:32.402511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe566-5ca5-40e0-94fa-40c5ba849e55 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:32.402511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe566-5ca5-40e0-94fa-40c5ba849e55 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:32.404694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 749/1491] 10.222.0.25 () {54 vars in 927 bytes} [Wed Aug 31 04:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:01:32.412445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddca1cb-14ec-4d27-be18-80beb0dc57d3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:32.412918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddca1cb-14ec-4d27-be18-80beb0dc57d3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:32.413111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddca1cb-14ec-4d27-be18-80beb0dc57d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:32.482034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fddca1cb-14ec-4d27-be18-80beb0dc57d3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:01:32.483249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fddca1cb-14ec-4d27-be18-80beb0dc57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:32.587484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 743/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Wed Aug 31 04:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:01:32.878051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe566-5ca5-40e0-94fa-40c5ba849e55 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:01:32.880499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0eabe566-5ca5-40e0-94fa-40c5ba849e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:33.009812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe566-5ca5-40e0-94fa-40c5ba849e55 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:01:33.103148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:01:33.103746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:01:33.104020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:01:33.104290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:01:33.105916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:01:33.115034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:33.222821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:01:33.224259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21571f38-03b4-4957-8ff0-34d363ee6f2b service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:01:33.242621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 750/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:01:42.585622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=82 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:01:43.240205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=50 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:52.300369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:52.301353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:52.301353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:52.517068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:02:52.518314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:52.621124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 744/1494] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:02:52.629818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:52.630327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:52.630327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:52.710786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:02:52.711977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:52.820173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 751/1495] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:02:52.827677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:52.829631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:52.847998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e933fe-20f1-44bb-a677-ef517c9615be None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:52.912452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:52.946759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:52.947365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:52.947639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:52.947903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:52.948734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:02:52.949061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:52.950076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:52.950076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:02:52.950076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:02:52.950948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:52.962649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 745/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:02:52.971036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:52.980696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8dcec-46ec-4234-93cf-08d5086c6a60 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:53.046180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:53.084512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:53.085186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:53.085459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:53.085721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:53.086340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:53.088090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:53.088090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:02:53.088090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:02:53.089302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:53.149720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 752/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:02:52 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:02:53.154108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:53.155637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:53.190824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2234b-7466-48f9-8136-8ae1a80307d3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:53.287595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:53.288203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:53.288482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:53.288753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:53.289420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:53.290443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:53.290443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:02:53.290443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:02:53.291643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:53.341703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 746/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:02:53 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:02:53.346291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:53.347890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:53.410922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34eef2-e79a-440a-a2ff-02de27c42997 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:53.500829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:53.512863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:53.513481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:53.513769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:53.514018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:53.514654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:53.515671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:53.515671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:02:53.515671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:02:53.516584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:53.529677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 753/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:02:53.536531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:53.538749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:53.550184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc078be2-012f-43e0-ab87-64f607a71a16 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:53.575980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:53.649009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:53.649617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:53.649907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:53.650145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:53.650792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:53.651815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:53.651815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:02:53.651815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:02:53.652694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af5476-9d04-4b1e-a254-ae4900f31825 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:53.665073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 747/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:02:53.669726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:53.671259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:53.706136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f05c0-ffd1-44f1-b979-354c68596408 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:53.804767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:53.805468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:53.805743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:53.806005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] PATH_INFO: `/v3/projects/6021ad718c924ebaa45f929bcf9bd87e/users/3a1f34ba415546a79e5fc6142c21b260/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:53.836611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6021ad718c924ebaa45f929bcf9bd87e, user_id=3a1f34ba415546a79e5fc6142c21b260, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:53.838193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:53.838193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:02:53.838193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:02:53.841154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f5a3c-94c2-4ed6-9b98-3d4c38ae699d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:53.871876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 754/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:02:53 2022] PUT /identity/v3/projects/6021ad718c924ebaa45f929bcf9bd87e/users/3a1f34ba415546a79e5fc6142c21b260/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:02:53.885010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c62db-a948-441d-b595-eacf78e1ff98 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:53.885291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c62db-a948-441d-b595-eacf78e1ff98 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:53.885581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c62db-a948-441d-b595-eacf78e1ff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:53.942452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5d7c62db-a948-441d-b595-eacf78e1ff98 None None] MFA Rules not processed for user `3a1f34ba415546a79e5fc6142c21b260`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:02:53.943652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d7c62db-a948-441d-b595-eacf78e1ff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:54.030942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:02:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:02:54.044648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93980226-e621-4eef-8998-992d9397d99c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:54.045003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93980226-e621-4eef-8998-992d9397d99c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:54.045278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93980226-e621-4eef-8998-992d9397d99c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:54.046642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 755/1503] 10.222.0.25 () {54 vars in 964 bytes} [Wed Aug 31 04:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:02:54.051566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069551b-dee5-4b87-ab39-810f68cb8b33 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:54.051852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069551b-dee5-4b87-ab39-810f68cb8b33 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:54.052114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069551b-dee5-4b87-ab39-810f68cb8b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:54.085771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:54.132317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1069551b-dee5-4b87-ab39-810f68cb8b33 None None] MFA Rules not processed for user `5557665d603448c3bdeed0b5701e8ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:02:54.133582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1069551b-dee5-4b87-ab39-810f68cb8b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:54.212695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 749/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Aug 31 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:02:54.222515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93980226-e621-4eef-8998-992d9397d99c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:54.224094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-93980226-e621-4eef-8998-992d9397d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:54.276940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:54.332601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93980226-e621-4eef-8998-992d9397d99c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:54.410484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:54.411120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:54.411397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:54.411668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:54.413416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:54.514311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:54.515731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:54.519148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:54.541425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 756/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:02:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:02:54.590290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c1c3d-81d5-4d12-8eb8-4d1c282e584b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:54.590737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c1c3d-81d5-4d12-8eb8-4d1c282e584b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:54.590833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c1c3d-81d5-4d12-8eb8-4d1c282e584b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:54.592824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 750/1506] 10.222.0.25 () {52 vars in 830 bytes} [Wed Aug 31 04:02:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:02:54.596739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:54.598051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:54.707601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4480b2-ade3-44f5-b7e3-929c9eccbc0e service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:54.809193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:54.810498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:54.811009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:54.811517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] PATH_INFO: `/v3/users/3a1f34ba415546a79e5fc6142c21b260` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:54.834665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1f34ba415546a79e5fc6142c21b260)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:54.835832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:54.835832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:02:54.835832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:02:54.837084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:54.847765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:54.909171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1f34ba415546a79e5fc6142c21b260'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:54.933525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1f34ba415546a79e5fc6142c21b260'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:54.934006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1f34ba415546a79e5fc6142c21b260'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:54.934533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1f34ba415546a79e5fc6142c21b260'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:54.950072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1f34ba415546a79e5fc6142c21b260'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:54.968366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:02:54 2022] DELETE /identity/v3/users/3a1f34ba415546a79e5fc6142c21b260 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:02:54.973490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:54.973837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:54.974213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:55.033499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:02:55.035411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:55.147447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:55.168195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:02:55.182951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:55.184191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:55.288482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b774b45-1284-40ca-b891-55d99c34ef3c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:55.369560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:02:55.398130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:55.398691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:55.398931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:55.399215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:55.400831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:55.531041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:55.533131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284498e-0637-4452-9479-b9af2ec170f4 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:55.553992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 758/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:02:55.945395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:02:55.946625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:02:55.959204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeebfe-40a8-45f7-8158-55c21eaffff9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:02:56.059138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:02:56.059770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:02:56.060031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:02:56.060305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] PATH_INFO: `/v3/projects/6021ad718c924ebaa45f929bcf9bd87e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:02:56.070286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6021ad718c924ebaa45f929bcf9bd87e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:02:56.071357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:02:56.071357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:02:56.071357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:02:56.072580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:02:56.132831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6021ad718c924ebaa45f929bcf9bd87e', 'request_id': 'req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:56.138892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6021ad718c924ebaa45f929bcf9bd87e', 'request_id': 'req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:56.149850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6021ad718c924ebaa45f929bcf9bd87e', 'request_id': 'req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:56.181745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] The token cache is being invalidate because project 6021ad718c924ebaa45f929bcf9bd87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:02:56.182036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:56.182461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-184350c6-b1b6-4cb6-9cd0-93aac23c0ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:02:56.183880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 752/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:02:55 2022] DELETE /identity/v3/projects/6021ad718c924ebaa45f929bcf9bd87e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:03:05.551056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=62 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:03:06.179807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:28.487223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512101-115c-416d-9e30-aec59eb1ce4a None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:28.487859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512101-115c-416d-9e30-aec59eb1ce4a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:28.487859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512101-115c-416d-9e30-aec59eb1ce4a None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:28.489866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:04:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:28.497894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171149e-1a69-40cd-93b3-13bef7c2b623 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:28.498330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171149e-1a69-40cd-93b3-13bef7c2b623 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:28.498484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171149e-1a69-40cd-93b3-13bef7c2b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:28.587501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8171149e-1a69-40cd-93b3-13bef7c2b623 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:28.588751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8171149e-1a69-40cd-93b3-13bef7c2b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:28.701917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:28.853771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512101-115c-416d-9e30-aec59eb1ce4a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:28.856518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-93512101-115c-416d-9e30-aec59eb1ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:28.989303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512101-115c-416d-9e30-aec59eb1ce4a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:28.994851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5efa8-a06d-48e3-8ec1-2e75cabc2ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:28.995560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5efa8-a06d-48e3-8ec1-2e75cabc2ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:28.995797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5efa8-a06d-48e3-8ec1-2e75cabc2ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:28.996064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5efa8-a06d-48e3-8ec1-2e75cabc2ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:29.004936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5efa8-a06d-48e3-8ec1-2e75cabc2ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:29.006571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5efa8-a06d-48e3-8ec1-2e75cabc2ac9 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:29.015853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 760/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:04:29.863772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970648c7-8e51-42dd-9d8d-f28df3065a80 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:29.864676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970648c7-8e51-42dd-9d8d-f28df3065a80 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:29.864676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970648c7-8e51-42dd-9d8d-f28df3065a80 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:29.866861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:29.872951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0753a-2d7e-40d7-ab97-3f2ff823f71b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:29.873683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0753a-2d7e-40d7-ab97-3f2ff823f71b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:29.873856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0753a-2d7e-40d7-ab97-3f2ff823f71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:29.895499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e6a0753a-2d7e-40d7-ab97-3f2ff823f71b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:29.896669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e6a0753a-2d7e-40d7-ab97-3f2ff823f71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:29.906168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:30.059477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970648c7-8e51-42dd-9d8d-f28df3065a80 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:30.082425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970648c7-8e51-42dd-9d8d-f28df3065a80 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:30.089074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9e491-cd72-4c46-9293-e0b9e85ad07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:30.089672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e491-cd72-4c46-9293-e0b9e85ad07b service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:30.089947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e491-cd72-4c46-9293-e0b9e85ad07b service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:30.090242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e491-cd72-4c46-9293-e0b9e85ad07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:30.098840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9e491-cd72-4c46-9293-e0b9e85ad07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:30.100441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9e491-cd72-4c46-9293-e0b9e85ad07b service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:30.110233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 755/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:04:30.873438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80878c6b-f48b-454a-8d93-00b8ebda8df4 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:30.874271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80878c6b-f48b-454a-8d93-00b8ebda8df4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:30.874271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80878c6b-f48b-454a-8d93-00b8ebda8df4 None None] PATH_INFO: `/v3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:30.876215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 762/1517] 10.222.0.15 () {54 vars in 925 bytes} [Wed Aug 31 04:04:30 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:04:30.893575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1756864-b320-4453-9a57-4fa78b42f8af None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:30.894016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1756864-b320-4453-9a57-4fa78b42f8af None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:30.894122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1756864-b320-4453-9a57-4fa78b42f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:30.958876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e1756864-b320-4453-9a57-4fa78b42f8af None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:30.960109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e1756864-b320-4453-9a57-4fa78b42f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:30.979517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:31.038397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 756/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 31 04:04:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:39.890623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=56 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:40.411933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2ce66-dff6-4607-9919-81926de61474 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:40.412156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2ce66-dff6-4607-9919-81926de61474 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:40.412402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2ce66-dff6-4607-9919-81926de61474 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:40.413801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 763/1519] 10.222.0.25 () {54 vars in 961 bytes} [Wed Aug 31 04:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:40.418962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f97b9-388b-40ab-a1e1-849b349e5246 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:40.419445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f97b9-388b-40ab-a1e1-849b349e5246 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:40.419619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f97b9-388b-40ab-a1e1-849b349e5246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:40.441840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-396f97b9-388b-40ab-a1e1-849b349e5246 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:40.443040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-396f97b9-388b-40ab-a1e1-849b349e5246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:40.453104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 757/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Aug 31 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:40.461126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2ce66-dff6-4607-9919-81926de61474 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:40.476313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2ce66-dff6-4607-9919-81926de61474 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:40.481564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b704a9e-b568-4325-9be9-c4a98674bcd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:40.482250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704a9e-b568-4325-9be9-c4a98674bcd4 service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:40.482529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704a9e-b568-4325-9be9-c4a98674bcd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:40.482802 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704a9e-b568-4325-9be9-c4a98674bcd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:40.492271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b704a9e-b568-4325-9be9-c4a98674bcd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:40.493918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b704a9e-b568-4325-9be9-c4a98674bcd4 service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:40.504712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 764/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:04:41.322228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0ca3-1602-4b32-83e1-3678ba2ace18 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:41.322518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0ca3-1602-4b32-83e1-3678ba2ace18 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:41.322787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff0ca3-1602-4b32-83e1-3678ba2ace18 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:41.324368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:41.330133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0b67-da8d-4eb1-a39d-2835781aee8b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:41.330607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0b67-da8d-4eb1-a39d-2835781aee8b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:41.330724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0b67-da8d-4eb1-a39d-2835781aee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:41.355770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2a7b0b67-da8d-4eb1-a39d-2835781aee8b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:41.357009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2a7b0b67-da8d-4eb1-a39d-2835781aee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:41.365496 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:41.521699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0ca3-1602-4b32-83e1-3678ba2ace18 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:41.543379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff0ca3-1602-4b32-83e1-3678ba2ace18 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:41.549731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c239ac-a170-4b9d-b16e-0b69bfcc46c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:41.550366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c239ac-a170-4b9d-b16e-0b69bfcc46c0 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:41.550642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c239ac-a170-4b9d-b16e-0b69bfcc46c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:41.550912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c239ac-a170-4b9d-b16e-0b69bfcc46c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:41.559264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c239ac-a170-4b9d-b16e-0b69bfcc46c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:41.560918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c239ac-a170-4b9d-b16e-0b69bfcc46c0 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:41.570836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 759/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:04:42.380312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceff6ef-55c4-426e-b26c-3ea6c0af050e None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:42.380936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceff6ef-55c4-426e-b26c-3ea6c0af050e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:42.380936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceff6ef-55c4-426e-b26c-3ea6c0af050e None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:42.382209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 04:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:42.388331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae4dc-2ac4-4470-8199-2873fce3cd38 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:42.388834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae4dc-2ac4-4470-8199-2873fce3cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:42.389235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae4dc-2ac4-4470-8199-2873fce3cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:42.411281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-076ae4dc-2ac4-4470-8199-2873fce3cd38 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:42.412478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-076ae4dc-2ac4-4470-8199-2873fce3cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:42.421732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:42.579184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceff6ef-55c4-426e-b26c-3ea6c0af050e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:42.595703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceff6ef-55c4-426e-b26c-3ea6c0af050e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:42.601959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0649-d95b-44ab-bbaa-91d63e0bee0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:42.602557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0649-d95b-44ab-bbaa-91d63e0bee0e service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:42.602840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0649-d95b-44ab-bbaa-91d63e0bee0e service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:42.603110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0649-d95b-44ab-bbaa-91d63e0bee0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:42.611698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b0649-d95b-44ab-bbaa-91d63e0bee0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:42.613295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b0649-d95b-44ab-bbaa-91d63e0bee0e service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:42.622788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 767/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:04:46.514068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81750af-7c35-48f2-9211-3cb3a2593093 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:46.514623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81750af-7c35-48f2-9211-3cb3a2593093 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:46.514623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81750af-7c35-48f2-9211-3cb3a2593093 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:46.516300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:46.524753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536896-ca2a-4b0b-8bd2-75fe0150fb09 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:46.525223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536896-ca2a-4b0b-8bd2-75fe0150fb09 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:46.525334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536896-ca2a-4b0b-8bd2-75fe0150fb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:46.550336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-39536896-ca2a-4b0b-8bd2-75fe0150fb09 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:46.551516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-39536896-ca2a-4b0b-8bd2-75fe0150fb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:46.560666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:46.851122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81750af-7c35-48f2-9211-3cb3a2593093 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:46.854261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c81750af-7c35-48f2-9211-3cb3a2593093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:46.943519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81750af-7c35-48f2-9211-3cb3a2593093 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:46.947648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be228b5-803a-49c7-b465-9cd596927cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:46.948195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be228b5-803a-49c7-b465-9cd596927cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:46.948475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be228b5-803a-49c7-b465-9cd596927cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:46.948747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be228b5-803a-49c7-b465-9cd596927cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:46.958319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be228b5-803a-49c7-b465-9cd596927cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:46.959749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be228b5-803a-49c7-b465-9cd596927cf0 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:46.969349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 762/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:04:48.855671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2d3e2-dd0d-47c2-ae27-fe032c942ee6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:48.856589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2d3e2-dd0d-47c2-ae27-fe032c942ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:48.856589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2d3e2-dd0d-47c2-ae27-fe032c942ee6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:48.858735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:04:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:48.864322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9625e-ce8d-4409-8551-d46239623ca4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:48.864770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9625e-ce8d-4409-8551-d46239623ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:48.864888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9625e-ce8d-4409-8551-d46239623ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:48.886304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5cb9625e-ce8d-4409-8551-d46239623ca4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:48.887482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5cb9625e-ce8d-4409-8551-d46239623ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:48.895894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:04:49.179261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2d3e2-dd0d-47c2-ae27-fe032c942ee6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:49.191359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2d3e2-dd0d-47c2-ae27-fe032c942ee6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:49.195435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd7323-ca95-4d66-8161-fb4a53e0c977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:49.196025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7323-ca95-4d66-8161-fb4a53e0c977 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:49.196295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7323-ca95-4d66-8161-fb4a53e0c977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:49.196560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd7323-ca95-4d66-8161-fb4a53e0c977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:49.206216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd7323-ca95-4d66-8161-fb4a53e0c977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:49.207622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd7323-ca95-4d66-8161-fb4a53e0c977 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:49.216945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 770/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:04:52.592608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527bf5c-0691-4984-b05a-7073aec6cab7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:52.593219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527bf5c-0691-4984-b05a-7073aec6cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:52.593219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527bf5c-0691-4984-b05a-7073aec6cab7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:52.595277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:04:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:52.601263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d069a1-efee-4e59-b388-f5a034d142ce None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:52.601702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d069a1-efee-4e59-b388-f5a034d142ce None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:52.601796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d069a1-efee-4e59-b388-f5a034d142ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:52.631175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-20d069a1-efee-4e59-b388-f5a034d142ce None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:52.632381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-20d069a1-efee-4e59-b388-f5a034d142ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:52.641679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:53.195483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527bf5c-0691-4984-b05a-7073aec6cab7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:53.197435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1527bf5c-0691-4984-b05a-7073aec6cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:53.265024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:04:53.279717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527bf5c-0691-4984-b05a-7073aec6cab7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:53.284168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734477c-5636-4c26-8212-1657d179fba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:53.284782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734477c-5636-4c26-8212-1657d179fba8 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:53.285093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734477c-5636-4c26-8212-1657d179fba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:53.285356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734477c-5636-4c26-8212-1657d179fba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:53.294473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734477c-5636-4c26-8212-1657d179fba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:53.295901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734477c-5636-4c26-8212-1657d179fba8 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:53.305470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 765/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:04:55.219135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c83bd-aab3-481c-83ae-ec3581c0ee1d None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:55.220158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c83bd-aab3-481c-83ae-ec3581c0ee1d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:55.220158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c83bd-aab3-481c-83ae-ec3581c0ee1d None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:55.222247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 04:04:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:04:55.230955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89d8a-f3a2-4127-b8a0-e3d8b24015f2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:55.231404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89d8a-f3a2-4127-b8a0-e3d8b24015f2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:55.231542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea89d8a-f3a2-4127-b8a0-e3d8b24015f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:55.254889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dea89d8a-f3a2-4127-b8a0-e3d8b24015f2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:04:55.256118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dea89d8a-f3a2-4127-b8a0-e3d8b24015f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:55.265650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 04:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:04:55.818702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c83bd-aab3-481c-83ae-ec3581c0ee1d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:04:55.820822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3e1c83bd-aab3-481c-83ae-ec3581c0ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:04:55.840332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c83bd-aab3-481c-83ae-ec3581c0ee1d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:04:55.845699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e837513-dd22-4985-9b19-0cb7dfe51596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:04:55.846303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837513-dd22-4985-9b19-0cb7dfe51596 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:04:55.846573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837513-dd22-4985-9b19-0cb7dfe51596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:04:55.846835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837513-dd22-4985-9b19-0cb7dfe51596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:04:55.857357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e837513-dd22-4985-9b19-0cb7dfe51596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:04:55.858761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e837513-dd22-4985-9b19-0cb7dfe51596 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:04:55.868145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 773/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:05:05.249371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=11 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:05:05.864402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=33 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:27.335783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f4eb-36b6-483d-b73f-ae12728be0e4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.337027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f4eb-36b6-483d-b73f-ae12728be0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.337537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f4eb-36b6-483d-b73f-ae12728be0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.363009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0743f4eb-36b6-483d-b73f-ae12728be0e4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.364222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0743f4eb-36b6-483d-b73f-ae12728be0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.375236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 767/1540] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:27.380706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.381734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.382280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.384716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6b84-a298-428b-bb78-500a9986d990 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.387083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6b84-a298-428b-bb78-500a9986d990 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.387083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6b84-a298-428b-bb78-500a9986d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.415200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-df9d6b84-a298-428b-bb78-500a9986d990 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.416454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-df9d6b84-a298-428b-bb78-500a9986d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.416761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.418313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.434913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 768/1541] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:27.436258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe075a7-3209-4569-82b3-395cc7e5ee4f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.436544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe075a7-3209-4569-82b3-395cc7e5ee4f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.436841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe075a7-3209-4569-82b3-395cc7e5ee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.442226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 774/1542] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.449634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.468056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c427a9-9567-4ea4-be60-38add08f2f48 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.471811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1fe075a7-3209-4569-82b3-395cc7e5ee4f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.471811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1fe075a7-3209-4569-82b3-395cc7e5ee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.500636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 769/1543] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.500988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.502253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e197512-b9b3-4070-a177-08fd7788820b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.502537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e197512-b9b3-4070-a177-08fd7788820b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.502665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.502852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e197512-b9b3-4070-a177-08fd7788820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.502962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.503131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.506253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:27.506709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:06:27.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:06:27.508655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:06:27.512833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c518de-15d4-4a9c-b4cd-6db7a42f0b7f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.555680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3e197512-b9b3-4070-a177-08fd7788820b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.558935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 775/1544] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:27.560709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3e197512-b9b3-4070-a177-08fd7788820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.561255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878ae5-5876-42a8-a60e-7ea1c60cb353 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.561546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878ae5-5876-42a8-a60e-7ea1c60cb353 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.561820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6878ae5-5876-42a8-a60e-7ea1c60cb353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.571936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 770/1545] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.573461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.573794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.574070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.586373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e6878ae5-5876-42a8-a60e-7ea1c60cb353 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.587606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e6878ae5-5876-42a8-a60e-7ea1c60cb353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.597781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 776/1546] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.599174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5580a8-5d04-4afe-be6f-e25bd531b4bb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.599531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5580a8-5d04-4afe-be6f-e25bd531b4bb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.599896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5580a8-5d04-4afe-be6f-e25bd531b4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.610848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.612400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.621289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-bd5580a8-5d04-4afe-be6f-e25bd531b4bb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.622228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 771/1547] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.623416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.625387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bd5580a8-5d04-4afe-be6f-e25bd531b4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.633920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73bdd3-56e9-4459-9197-8325dcbca0ab None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.644896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 777/1548] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.644896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.644896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.644896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.646203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.647021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.647302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.647910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.648302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.649502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:06:27.649502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:06:27.649502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:06:27.651232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dbae2-f20f-41ca-bb39-41756c68644c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.662939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.664138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.673033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 778/1549] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.673858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.683078 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b53c58-00d0-46b1-bae7-4158ed03fb6d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.688163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.688893 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.689233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.689562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.690269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:27.690629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.692311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc775464-081f-4642-a328-965fb761e0dd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.712828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 772/1550] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:27.713054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 779/1551] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:27.713183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba91a-a585-4d44-935e-f1dec7e6f26a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.713183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba91a-a585-4d44-935e-f1dec7e6f26a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.713371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.713461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba91a-a585-4d44-935e-f1dec7e6f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.713566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.713566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.728313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-39dba91a-a585-4d44-935e-f1dec7e6f26a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.731260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.732453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.733660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-39dba91a-a585-4d44-935e-f1dec7e6f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.792718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 780/1552] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.793733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.797232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 773/1553] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.798504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdcb7e-76c3-4fd6-828a-e64f1b568b59 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.798787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdcb7e-76c3-4fd6-828a-e64f1b568b59 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.799059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdcb7e-76c3-4fd6-828a-e64f1b568b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.810177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2035-cc05-402d-ace9-ed28d18e01c6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.815481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.816088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.816369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.816669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.817409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:27.817706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.818019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-31cdcb7e-76c3-4fd6-828a-e64f1b568b59 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.819194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-31cdcb7e-76c3-4fd6-828a-e64f1b568b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.819320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5facd-5efd-4eae-870d-4a6b62751e84 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.827016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 774/1554] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.828223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.828499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.828740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.839293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 781/1555] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:27.839293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.839293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.839293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.847994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.849221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.856046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.857222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.857596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 775/1556] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.861647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.866175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 782/1557] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:27.866991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.871318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd653ee0-e3e0-454f-ba47-26cbb6015d10 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.876203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.876813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8a238-1a12-4084-9816-90ba181bde5c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.876920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.877108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.877385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.878013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.879936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.881572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281673b7-3862-46bf-8b45-175e713af6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.882166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281673b7-3862-46bf-8b45-175e713af6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.882478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281673b7-3862-46bf-8b45-175e713af6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.882750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281673b7-3862-46bf-8b45-175e713af6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.883380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281673b7-3862-46bf-8b45-175e713af6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.885350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281673b7-3862-46bf-8b45-175e713af6b5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.904758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 776/1558] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/users => generated 284 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:27.904758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:27.915096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3372ab-a95d-4375-8a08-20a9c1143ce4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:27.918303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 783/1559] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:27.919545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.919823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.920093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.922456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:27.923059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.923338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.923731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.924381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:27.924686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:27.926346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436814ea-244d-4102-8425-acb22a506eb4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:27.938677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 777/1560] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:27.939933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:27.940219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:27.940489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:27.940672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.941885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:27.959095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:27.960280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:28.005591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 784/1561] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:28.006491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.007966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:28.016339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ae2a-bc21-4ccd-87e9-df39678608bb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.021649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.022248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.022463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 778/1562] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:28.022564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.022770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.023286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.023390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.025397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.030416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:28.032772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be26ba-66a5-4d39-ae2f-7a807e0ecacd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.037650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.038251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.038524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.038794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.039438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:28.039736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.041557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.054383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 779/1563] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:28.055187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.061235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 785/1564] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.062122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.066526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf09c61-43ca-4f90-be4c-b42ee59f7227 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.124536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.125100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.125437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.125709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.126353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:28.126655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.128254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.129007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd9494-50ba-4492-aefc-40149b7d8c54 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.133853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.134482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.134816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.135099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.135740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.137387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.141202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 780/1565] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:28.145673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.147535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 786/1566] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.148315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.156752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ab80-7fe1-4ec0-bf2c-5a40f44d3a63 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.157903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0602ae-c969-4173-b0ed-373075cd2993 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.161663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.162270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.162666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.162882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.163018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.163478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.163682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.163797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.164014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.164638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.165639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.166598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.189204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 781/1567] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.190140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.200644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051109-8897-47f0-bc6e-37366fb1a413 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.201676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 787/1568] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.202351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.262439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.263146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.263421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.263685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.264370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:28.264665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.266284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.266617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d3e9-a835-48ac-a2ec-943c7b6e2745 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.271273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.271877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.272158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.272429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.273089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:28.273413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.275043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.277650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 782/1569] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:28.278423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.287640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901c473-2f44-4284-9f61-3ab7df21aacf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.289895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 788/1570] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:28.290808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.298244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.298851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.299128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.299448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.300101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.300208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34faef-7cb2-4ae0-b238-150b927391bb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.302174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.304628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.305239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.305518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.305795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.306414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.308315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.327352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 783/1571] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.328235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.337686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 789/1572] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.338551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.340373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bc819-8196-4168-8fa3-c4375e3988f9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.369991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:28.371258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:28.399325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.399880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.400143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.400406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.401064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.401201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aed5a8-f88e-49d2-8361-8638874f1384 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.402993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.405911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.406515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.406868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.407083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.407716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.409951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.420318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 790/1573] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.421315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.430976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ae767-4708-4cd7-a0c2-f8a34e207f28 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.431875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 784/1574] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.432543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.490429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.491021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.491299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.491568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.492203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.493830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.494018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5065281-e164-41ff-9de9-eca641ee7667 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.498951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.499864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.500135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.500397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.501046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.502951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.504101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 791/1575] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.505055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.514600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0f22-7f9f-4824-b7d3-464e157df8bd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.519534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.520159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.520414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.520686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.521370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.523304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.528182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 785/1576] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.529422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.539701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09cb55-f675-4063-af70-251eaf081f8c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.545180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.545811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.546073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.546381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.547008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.548924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.556052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 792/1577] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.556052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.580069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 786/1578] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.582038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.615610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf421-3d6c-4ae1-a8a0-d1bd8a63b72a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.643201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707b2c4-5432-4f98-905d-339b058cacc5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.647777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.648384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.648665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.648961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.649645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.651565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.660997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:28.675349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 787/1579] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.675598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.676009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.676785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.677090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.677359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.678005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.679659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.685640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ea6fe-77c8-406e-9801-ab6353d5aa55 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.689977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 793/1580] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.690434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.690772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.691126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.691357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.691628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] PATH_INFO: `/v3/projects/53e48f6cc0d14583b6f7b6d95560ba88/users/e5277f69d04846fe904c8c02e7c8cbf1/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.705324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0833fbc-3cdc-4f79-9f7a-3765c901ad1f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.707272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:28.710418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.710679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e48f6cc0d14583b6f7b6d95560ba88, user_id=e5277f69d04846fe904c8c02e7c8cbf1, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.711038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.711311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.711575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.712087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:06:28.712087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:06:28.712087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:06:28.712360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.713324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:06:28.713324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:06:28.713324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:06:28.714225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.714520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.728977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 788/1581] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:28 2022] PUT /identity/v3/projects/53e48f6cc0d14583b6f7b6d95560ba88/users/e5277f69d04846fe904c8c02e7c8cbf1/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:28.733699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.739460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 794/1582] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.739460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.749049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ea16a-0665-41d0-a3da-150638b0e093 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.800006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c676a-2372-4af2-ac67-0c9f105b32e1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.804870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.805492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.805767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.806036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.806714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.808356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.815248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.815955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.816255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.816533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.817219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.818680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 789/1583] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.819649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.821285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.829972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63444b8-3555-4c9b-be52-c44bb7ac160f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.836090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 795/1584] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.836090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.836338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.836338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.836338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.836338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.837317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.839723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.843825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a396e-38f4-4e1e-8bff-8708e84bba9e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.848920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.849503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.849778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.850027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.850654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.852647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.863395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 790/1585] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.864491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.875685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 796/1586] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:28.876609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.876755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942c933-aa1e-4815-9886-86f847dbaf6b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.881743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.882472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.882862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.883141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.883780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.885419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.886517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dba91-9bb1-4447-b698-b1d8cc0435a9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.891019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792c0c-fb25-45e1-997a-b68e02a249db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.891596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792c0c-fb25-45e1-997a-b68e02a249db admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.891873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792c0c-fb25-45e1-997a-b68e02a249db admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.892142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792c0c-fb25-45e1-997a-b68e02a249db admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.892772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53792c0c-fb25-45e1-997a-b68e02a249db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.894389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53792c0c-fb25-45e1-997a-b68e02a249db admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.900106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 791/1587] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.901117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.905215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 797/1588] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.906394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.906659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.907027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.912426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e7d9-0c89-41bf-baf3-1ac270ec9e4d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.917608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.918329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.918704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.919070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.919811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.921538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.932015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 792/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:28.933016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:28.936770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] MFA Rules not processed for user `e5277f69d04846fe904c8c02e7c8cbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:28.938028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:28.942599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110cc69-1150-4cf9-aae1-37581dd803de admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:28.947743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:28.948448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:28.948727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:28.949028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] PATH_INFO: `/v3/projects/55b66adef4f04038a5b54f5dffc93011/users/62400b08a4a64692a2dc43026f4a7986/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:28.963748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b66adef4f04038a5b54f5dffc93011, user_id=62400b08a4a64692a2dc43026f4a7986, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:28.966428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:28.979668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 793/1590] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:28 2022] PUT /identity/v3/projects/55b66adef4f04038a5b54f5dffc93011/users/62400b08a4a64692a2dc43026f4a7986/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:28.980642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.007860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 798/1591] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:29.008604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.018600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63100c49-5b7a-4b48-b735-f17860f782a3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.038079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:29.046877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a729fa-5f68-410e-ac97-4d33f0c02a3f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.051523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.052144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.052423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.052696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.053370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.054997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.064670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 794/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.064670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.075214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86815bd-0396-4eef-a1a3-4488e01d0afe admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.076118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.076732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.077018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.077303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.077949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.079521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.080289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.080893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.081204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.081464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.082094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.083655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.091427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 799/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.092258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.104572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 795/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.104572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.104917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cea1-1f77-4c5a-a345-c2ac16f53d7f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.109706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.110323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.110596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.110862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.111544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.113265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.114213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86d6b-6a88-4881-baca-3382bef0cd75 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.119175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.119849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.120121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.120395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] PATH_INFO: `/v3/projects/2adf2839135346ecb3915016289d7b82/users/45de14fdfb4347918b93e8871d718043/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.123669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:29.127598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 800/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.127598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.135022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e73b2-1dfe-4999-b0e8-229d01d1b237 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.139880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40998ea-3241-4fbd-aaa1-7f947db177fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.140492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40998ea-3241-4fbd-aaa1-7f947db177fb admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.140747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40998ea-3241-4fbd-aaa1-7f947db177fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.141045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40998ea-3241-4fbd-aaa1-7f947db177fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.141677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40998ea-3241-4fbd-aaa1-7f947db177fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.143234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40998ea-3241-4fbd-aaa1-7f947db177fb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.143704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adf2839135346ecb3915016289d7b82, user_id=45de14fdfb4347918b93e8871d718043, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.146532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.154149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 801/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.155224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.155511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.155768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.163473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 796/1597] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:29 2022] PUT /identity/v3/projects/2adf2839135346ecb3915016289d7b82/users/45de14fdfb4347918b93e8871d718043/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:29.164277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.178349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.179538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.227997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb416a99-71aa-4c49-bde2-719fd81b7635 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.232983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.233661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.234007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.234347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.235051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.237048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.237188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 802/1598] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:29.237875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.248345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b4db9-7163-4fa5-a26b-945cbf31e7bb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.253347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.254005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.254284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.254555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] PATH_INFO: `/v3/projects/1e679bb0370e45849ef466721cb4e979/users/05a4d967d13742998fab86f157e550c7/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.268843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 797/1599] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:29.268843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.272814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e679bb0370e45849ef466721cb4e979, user_id=05a4d967d13742998fab86f157e550c7, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.275558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.289446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 803/1600] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:29 2022] PUT /identity/v3/projects/1e679bb0370e45849ef466721cb4e979/users/05a4d967d13742998fab86f157e550c7/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:29.290363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.327840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb05f90-8ca6-4156-9f37-48d4f6d0f5b4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.350699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014230a-6c34-4fbf-8f9f-6aa48bbccc37 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.355399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.356031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.356307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.356603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.357277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.358928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.369353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 804/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.370182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.380059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f6f6-7a8c-4961-b81d-997759d4092a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.384910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b38dea-3ff0-405b-9ec4-19a52c8f7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.385418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.385871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b38dea-3ff0-405b-9ec4-19a52c8f7bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.385871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b38dea-3ff0-405b-9ec4-19a52c8f7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.386062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.386269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b38dea-3ff0-405b-9ec4-19a52c8f7bbf admin admin] PATH_INFO: `/v3/projects/a8340758d70f486b85452807b3b9fff7/users/2e51f5d067a94c2aa55d5cbb957f053f/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.386409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.386569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.387215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.388906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.394739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:29.399653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 798/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.400419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.402263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b38dea-3ff0-405b-9ec4-19a52c8f7bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8340758d70f486b85452807b3b9fff7, user_id=2e51f5d067a94c2aa55d5cbb957f053f, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.405185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b38dea-3ff0-405b-9ec4-19a52c8f7bbf admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.411138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda973-f13b-4612-9d2b-bf1593fc217d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.416340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.417174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.417454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.417729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] PATH_INFO: `/v3/projects/920d496d52e44246ad9a9a31a3c9062b/users/a3a98eacfbcd4825bf62913759682a01/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.419737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 805/1603] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:29 2022] PUT /identity/v3/projects/a8340758d70f486b85452807b3b9fff7/users/2e51f5d067a94c2aa55d5cbb957f053f/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:29.421019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.421296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.421559 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.440459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.440928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:29.441678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.446442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920d496d52e44246ad9a9a31a3c9062b, user_id=a3a98eacfbcd4825bf62913759682a01, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.449460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.463184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 799/1604] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:29 2022] PUT /identity/v3/projects/920d496d52e44246ad9a9a31a3c9062b/users/a3a98eacfbcd4825bf62913759682a01/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:29.464187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.506452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 806/1605] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:29.507272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.516458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6c5ea-35f8-4091-9683-8b7fd79752db None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.525360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a371-d9a7-4280-83a4-9ca22578edf2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.529104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.529716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.529993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.530259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.571373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576d79-47f0-4ed8-94ef-8713ea265bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.572010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576d79-47f0-4ed8-94ef-8713ea265bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.572349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576d79-47f0-4ed8-94ef-8713ea265bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.572621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576d79-47f0-4ed8-94ef-8713ea265bdd admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.573281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576d79-47f0-4ed8-94ef-8713ea265bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.575516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576d79-47f0-4ed8-94ef-8713ea265bdd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.592548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.594045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.595748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 807/1606] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:29.598515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.599129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.599408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.603707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 800/1607] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:29.604363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.613812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef442a9c-1b34-4d41-8c6a-8177a7646f81 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.619959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c09b8-7044-456b-8f92-1b4431978ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.620128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.620637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c09b8-7044-456b-8f92-1b4431978ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.620958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c09b8-7044-456b-8f92-1b4431978ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.621235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c09b8-7044-456b-8f92-1b4431978ab1 admin admin] PATH_INFO: `/v3/projects/25b55bb64ff447e5af6af2141659957b/users/160a2efe0f8841cebefa86779bf33c63/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.621962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.634849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 808/1608] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:29.634849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.642745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96487bf6-c3e1-4749-b3da-ebd85f028764 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.648151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c09b8-7044-456b-8f92-1b4431978ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b55bb64ff447e5af6af2141659957b, user_id=160a2efe0f8841cebefa86779bf33c63, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.648749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c525fbf-288b-4697-8f4d-b464c522a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.649540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525fbf-288b-4697-8f4d-b464c522a538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.649882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525fbf-288b-4697-8f4d-b464c522a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.650218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c525fbf-288b-4697-8f4d-b464c522a538 admin admin] PATH_INFO: `/v3/projects/aa6a9ef5090d4a0eafeae3ff3ef02de7/users/ba717b58c13d4bd7bd4b9399667345d2/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.651767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c09b8-7044-456b-8f92-1b4431978ab1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.668073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 801/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:29 2022] PUT /identity/v3/projects/25b55bb64ff447e5af6af2141659957b/users/160a2efe0f8841cebefa86779bf33c63/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:29.668271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525fbf-288b-4697-8f4d-b464c522a538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6a9ef5090d4a0eafeae3ff3ef02de7, user_id=ba717b58c13d4bd7bd4b9399667345d2, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.669576 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.669867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.670159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.676661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c525fbf-288b-4697-8f4d-b464c522a538 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.693074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 809/1610] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:29 2022] PUT /identity/v3/projects/aa6a9ef5090d4a0eafeae3ff3ef02de7/users/ba717b58c13d4bd7bd4b9399667345d2/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:29.694563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.695174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.695449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.717649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] MFA Rules not processed for user `2e51f5d067a94c2aa55d5cbb957f053f`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.717871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.718915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.719067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.769304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:29.795576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 810/1611] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:29.796452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.803318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 802/1612] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:29.807121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.818165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:29.823309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae49422-2a79-4159-bfac-3420cf249b17 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.830684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.831604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.832418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.832827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.834103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.836340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.849767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 803/1613] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:29.850589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:29.857037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.877786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3838d5-d61b-4837-9dfe-a041e52503f0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.881532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee113a-545f-4ebb-87a3-401a4e0aa480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.882526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee113a-545f-4ebb-87a3-401a4e0aa480 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.882816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee113a-545f-4ebb-87a3-401a4e0aa480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.883088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee113a-545f-4ebb-87a3-401a4e0aa480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.893286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee113a-545f-4ebb-87a3-401a4e0aa480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.894730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee113a-545f-4ebb-87a3-401a4e0aa480 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.905253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 811/1614] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:29.906587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.906873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.907143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.926924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c880e-55f0-4bdb-91ca-ddfc419e0c17 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:29.931097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df79c7-0cfa-453b-a927-789f974edbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:29.931947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df79c7-0cfa-453b-a927-789f974edbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.932445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df79c7-0cfa-453b-a927-789f974edbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.933041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df79c7-0cfa-453b-a927-789f974edbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.936969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] MFA Rules not processed for user `160a2efe0f8841cebefa86779bf33c63`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.938177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:29.944931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df79c7-0cfa-453b-a927-789f974edbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:29.946972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df79c7-0cfa-453b-a927-789f974edbe3 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:29.958392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 804/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:29.960051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:29.960707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:29.961116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:29.985015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:29.986344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:30.000072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 805/1616] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:30.000072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.011443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb9e60-b370-4256-b088-f54c25cb24c0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.017865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.018714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.019142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.020095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.031872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.033534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.045342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 806/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:30.046396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.059368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 812/1618] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:30.059368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.059678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7312d3-1f57-4b49-969d-1c75a22d9ef2 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.064780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.065590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.065987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.066346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.067211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.069578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.071722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d1255-4086-4537-aa70-96cc036a3be7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.079443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b570-a224-4386-a124-072ab9243001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.080140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b570-a224-4386-a124-072ab9243001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.080423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b570-a224-4386-a124-072ab9243001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.080696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b570-a224-4386-a124-072ab9243001 admin admin] PATH_INFO: `/v3/projects/8776c6caa8fe4feeb03cef55f6670c44/users/e30e9eaac92f4257988a660da582815c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.105058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b570-a224-4386-a124-072ab9243001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8776c6caa8fe4feeb03cef55f6670c44, user_id=e30e9eaac92f4257988a660da582815c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.109853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 807/1619] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:30 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:30.111222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.111364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b570-a224-4386-a124-072ab9243001 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.143875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 813/1620] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:30 2022] PUT /identity/v3/projects/8776c6caa8fe4feeb03cef55f6670c44/users/e30e9eaac92f4257988a660da582815c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:30.147534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d67b-ad45-40e6-8264-21e025fb8e0c None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.148079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d67b-ad45-40e6-8264-21e025fb8e0c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.148958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d67b-ad45-40e6-8264-21e025fb8e0c None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.153045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 814/1621] 10.222.0.25 () {54 vars in 962 bytes} [Wed Aug 31 04:06:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:06:30.154373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d67b-ad45-40e6-8264-21e025fb8e0c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.209745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5a430-a6b1-456c-a6b6-7597f9916ca0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.245130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:30.257278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d67b-ad45-40e6-8264-21e025fb8e0c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.264691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.265356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.265652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.265940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.267268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.269488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.283925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d568f-8b14-495a-8617-cfd9b722a64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.285331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d568f-8b14-495a-8617-cfd9b722a64f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.285978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d568f-8b14-495a-8617-cfd9b722a64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.286481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d568f-8b14-495a-8617-cfd9b722a64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.296358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 815/1622] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:30 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:30.297426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.301113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d568f-8b14-495a-8617-cfd9b722a64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.303199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d568f-8b14-495a-8617-cfd9b722a64f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.308138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c7da-e9ab-4760-806a-b4c7cdb6bea9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.314619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.315243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.315524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.315799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.316504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.318373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.319309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 808/1623] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:30.321196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2d16c-b7f0-41e1-8fb0-3431913a5115 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.321327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2d16c-b7f0-41e1-8fb0-3431913a5115 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.321675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2d16c-b7f0-41e1-8fb0-3431913a5115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.330459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 816/1624] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:30.331264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.346701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6037-0e41-4f1e-9b53-f37eeeac634e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.347686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:30.353558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.354770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.355289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.355610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.356588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.359458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.366969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-54f2d16c-b7f0-41e1-8fb0-3431913a5115 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:30.368379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-54f2d16c-b7f0-41e1-8fb0-3431913a5115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:30.373719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 817/1625] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:30.374927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.386049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17061b2-c5b1-4fe4-9cfa-df7f9ac5b888 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.392177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.393384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.393704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.394003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] PATH_INFO: `/v3/projects/8776c6caa8fe4feeb03cef55f6670c44/users/e30e9eaac92f4257988a660da582815c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.397810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8776c6caa8fe4feeb03cef55f6670c44, user_id=e30e9eaac92f4257988a660da582815c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.401316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.414732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 818/1626] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:30 2022] PUT /identity/v3/projects/8776c6caa8fe4feeb03cef55f6670c44/users/e30e9eaac92f4257988a660da582815c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:30.415784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.479318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 809/1627] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Aug 31 04:06:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:30.480974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.481203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.481473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.547891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866e7da-573b-4db2-a2ff-709d196d6de0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.550143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] MFA Rules not processed for user `e30e9eaac92f4257988a660da582815c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:30.552110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:30.553731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.554699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.555196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.555773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] PATH_INFO: `/v3/projects/33a0fffb253f4210b3d4f585f7fb6c30/users/87fc7bbd75f94a00b1775b982d6c6ce5/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.576086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a0fffb253f4210b3d4f585f7fb6c30, user_id=87fc7bbd75f94a00b1775b982d6c6ce5, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.580057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.613304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 819/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:30 2022] PUT /identity/v3/projects/33a0fffb253f4210b3d4f585f7fb6c30/users/87fc7bbd75f94a00b1775b982d6c6ce5/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:30.613304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.714119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 810/1629] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:30.715947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.728958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b80b-135b-4e65-bf81-2e78c0b8e278 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.739159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d988b-1d28-4e00-a41c-a2ad0753ef76 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.739439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.741156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.741786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.742134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.817342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.818463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.818882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.819543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.820442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.823642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.839770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:30.845182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 811/1630] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:30.848351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.877343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:30.898990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.900905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:30.913843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 820/1631] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:30.928851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:30.940454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b103012-5774-4cd4-bc71-bd99b687ad7b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.947409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.948640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.949644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.950534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.955638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe9633-d9cf-48f9-a7f1-c50c8fd6a041 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:30.967865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ac91e-f26c-4d16-b6fa-761b6cfa189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:30.970756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ac91e-f26c-4d16-b6fa-761b6cfa189f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:30.971459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ac91e-f26c-4d16-b6fa-761b6cfa189f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:30.971459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ac91e-f26c-4d16-b6fa-761b6cfa189f admin admin] PATH_INFO: `/v3/projects/33a0fffb253f4210b3d4f585f7fb6c30/users/87fc7bbd75f94a00b1775b982d6c6ce5/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:30.976941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ac91e-f26c-4d16-b6fa-761b6cfa189f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a0fffb253f4210b3d4f585f7fb6c30, user_id=87fc7bbd75f94a00b1775b982d6c6ce5, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:30.983857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ac91e-f26c-4d16-b6fa-761b6cfa189f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:31.013022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 821/1632] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:30 2022] PUT /identity/v3/projects/33a0fffb253f4210b3d4f585f7fb6c30/users/87fc7bbd75f94a00b1775b982d6c6ce5/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:31.024439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:31.024729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:31.026518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:31.083526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:31.086135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:31.098970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] MFA Rules not processed for user `87fc7bbd75f94a00b1775b982d6c6ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:31.103275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:31.111205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 812/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:31.170901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:31.183768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638eb5a-d2b2-411c-8e85-39e46e27ebe6 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:31.263068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 822/1634] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:31.273695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:31.321456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:31.324014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:31.324306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:31.324862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:31.409507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a606-07f9-42c9-97be-1382096b0b4e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:31.419322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc9eb0-f789-419c-9479-5b7b095cc0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:31.420552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9eb0-f789-419c-9479-5b7b095cc0ce service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:31.421973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9eb0-f789-419c-9479-5b7b095cc0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:31.422998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9eb0-f789-419c-9479-5b7b095cc0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:31.448873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc9eb0-f789-419c-9479-5b7b095cc0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:31.450367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc9eb0-f789-419c-9479-5b7b095cc0ce service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:31.472685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:31.474236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:31.480095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 823/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:31.490366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e256b25-1e3c-4256-bf3e-73ee16af9cb9 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:31.490569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e256b25-1e3c-4256-bf3e-73ee16af9cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:31.491225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e256b25-1e3c-4256-bf3e-73ee16af9cb9 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:31.492563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 824/1636] 10.222.0.25 () {54 vars in 912 bytes} [Wed Aug 31 04:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 04:06:31.510050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:31.510324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:31.510782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:31.539513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 813/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:06:31.589743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:31.591797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:31.667176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:31.677890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a784a4-80b9-4b24-abd8-b720aadff6a6 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:31.690750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf7bf-8466-4ceb-b8e3-6a4e4598b617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:31.691349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:31.691479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf7bf-8466-4ceb-b8e3-6a4e4598b617 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:31.691707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf7bf-8466-4ceb-b8e3-6a4e4598b617 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:31.692406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf7bf-8466-4ceb-b8e3-6a4e4598b617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:31.730931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:31.735801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 825/1638] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:06:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:31.886848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf7bf-8466-4ceb-b8e3-6a4e4598b617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:31.890088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf7bf-8466-4ceb-b8e3-6a4e4598b617 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:31.916012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 814/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:32.309808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:32.328719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9019f6-6fcd-4f6a-9f1d-8c8ee50408ff None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:32.343280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857d7d8-9fd9-422f-98a6-cd1902f30729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:32.345031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857d7d8-9fd9-422f-98a6-cd1902f30729 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:32.345427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857d7d8-9fd9-422f-98a6-cd1902f30729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:32.345709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857d7d8-9fd9-422f-98a6-cd1902f30729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:32.380065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857d7d8-9fd9-422f-98a6-cd1902f30729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:32.387311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857d7d8-9fd9-422f-98a6-cd1902f30729 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:32.419197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 826/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:33.543863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ee2d-286d-43da-b8b1-8fe76b95076b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:33.544747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ee2d-286d-43da-b8b1-8fe76b95076b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:33.545267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473ee2d-286d-43da-b8b1-8fe76b95076b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:33.547186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 815/1641] 10.222.0.25 () {54 vars in 962 bytes} [Wed Aug 31 04:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:06:33.556399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a678-7cd5-4c15-8b59-2f0cfe5e3547 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:33.557026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a678-7cd5-4c15-8b59-2f0cfe5e3547 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:33.557026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a678-7cd5-4c15-8b59-2f0cfe5e3547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:33.614308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e7b5a678-7cd5-4c15-8b59-2f0cfe5e3547 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:33.617288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e7b5a678-7cd5-4c15-8b59-2f0cfe5e3547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:33.630985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 827/1642] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Aug 31 04:06:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:33.638050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e9b15-f899-4d4c-84b9-da93ef29adb9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:33.638813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e9b15-f899-4d4c-84b9-da93ef29adb9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:33.639384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e9b15-f899-4d4c-84b9-da93ef29adb9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:33.641476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 816/1643] 10.222.0.25 () {54 vars in 912 bytes} [Wed Aug 31 04:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:06:33.647973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426854-0652-473e-81df-8492081700a9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:33.648364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426854-0652-473e-81df-8492081700a9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:33.648697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426854-0652-473e-81df-8492081700a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:33.695955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-06426854-0652-473e-81df-8492081700a9 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:33.697290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-06426854-0652-473e-81df-8492081700a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:33.733247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 828/1644] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:06:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:33.757765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e9b15-f899-4d4c-84b9-da93ef29adb9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:33.784217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e9b15-f899-4d4c-84b9-da93ef29adb9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:33.790546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63914-b830-44d2-9541-2c3e04976ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:33.791776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63914-b830-44d2-9541-2c3e04976ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:33.792039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63914-b830-44d2-9541-2c3e04976ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:33.792354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63914-b830-44d2-9541-2c3e04976ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:33.808587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63914-b830-44d2-9541-2c3e04976ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:33.810554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63914-b830-44d2-9541-2c3e04976ca9 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:33.851512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 817/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:36.892385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426854-0652-473e-81df-8492081700a9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:37.162046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426854-0652-473e-81df-8492081700a9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:37.174102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:37.177960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:37.178463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:37.178893 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] PATH_INFO: `/v3/users/e5277f69d04846fe904c8c02e7c8cbf1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:37.180547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5277f69d04846fe904c8c02e7c8cbf1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:37.188721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:37.322804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5277f69d04846fe904c8c02e7c8cbf1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:37.361483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5277f69d04846fe904c8c02e7c8cbf1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:37.362789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5277f69d04846fe904c8c02e7c8cbf1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:37.365536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5277f69d04846fe904c8c02e7c8cbf1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:37.381661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5277f69d04846fe904c8c02e7c8cbf1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:37.410739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 829/1646] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:06:36 2022] DELETE /identity/v3/users/e5277f69d04846fe904c8c02e7c8cbf1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:37.415309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:37.415916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:37.416227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:37.467450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:37.472976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:37.645571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 818/1647] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:37.667865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:37.668899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:37.790813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:37.850647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e131f4-1741-4db7-b0e1-9a6ab9ef72e6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:37.857793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e5b7-c22d-4700-b9b3-ee711eb49c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:37.859453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e5b7-c22d-4700-b9b3-ee711eb49c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:37.861368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e5b7-c22d-4700-b9b3-ee711eb49c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:37.861796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e5b7-c22d-4700-b9b3-ee711eb49c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:37.888619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e5b7-c22d-4700-b9b3-ee711eb49c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:37.896500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e5b7-c22d-4700-b9b3-ee711eb49c4f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:37.922871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 830/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:40.047031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:40.049567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:40.070924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be263766-6214-47c4-b9d5-d24f46010d7a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:40.085346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:40.086421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:40.088112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:40.088703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] PATH_INFO: `/v3/users/160a2efe0f8841cebefa86779bf33c63` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:40.091164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160a2efe0f8841cebefa86779bf33c63)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:40.094696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: WARNING py.warnings [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:06:40.094696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: warnings.warn(msg) Aug 31 04:06:40.094696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: Aug 31 04:06:40.098927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:40.280962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160a2efe0f8841cebefa86779bf33c63'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:40.314227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160a2efe0f8841cebefa86779bf33c63'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:40.335887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160a2efe0f8841cebefa86779bf33c63'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:40.337124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160a2efe0f8841cebefa86779bf33c63'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:40.385815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160a2efe0f8841cebefa86779bf33c63'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:40.400754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 819/1649] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:06:40 2022] DELETE /identity/v3/users/160a2efe0f8841cebefa86779bf33c63 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:40.405397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:40.405903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:40.406026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:40.491460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:40.501369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:40.725609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 831/1650] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:40.803003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:40.804491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:40.862260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758623a-2a62-4ca7-a74a-0f742dd5a8a8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:40.869315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:40.869878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:40.870157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:40.870436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] PATH_INFO: `/v3/users/2e51f5d067a94c2aa55d5cbb957f053f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:40.871627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e51f5d067a94c2aa55d5cbb957f053f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:40.873731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:40.910649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:40.945931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:40.947626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:40.966756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb36bf-9f55-4eb2-8f8f-bc1060c2548f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:40.985827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:40.987891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:40.988385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:40.991617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] PATH_INFO: `/v3/projects/53e48f6cc0d14583b6f7b6d95560ba88` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:40.995739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e48f6cc0d14583b6f7b6d95560ba88)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:41.001173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: WARNING py.warnings [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 04:06:41.001173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: warnings.warn(msg) Aug 31 04:06:41.001173 dv-cinder-853910-5-smb devstack@keystone.service[81521]: Aug 31 04:06:41.002945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:41.034479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e51f5d067a94c2aa55d5cbb957f053f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.063062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e51f5d067a94c2aa55d5cbb957f053f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.089006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e51f5d067a94c2aa55d5cbb957f053f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.090484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e51f5d067a94c2aa55d5cbb957f053f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.117861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e51f5d067a94c2aa55d5cbb957f053f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.131102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 820/1651] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:06:40 2022] DELETE /identity/v3/users/2e51f5d067a94c2aa55d5cbb957f053f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:41.132209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:41.138130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:41.142888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e48f6cc0d14583b6f7b6d95560ba88', 'request_id': 'req-a8b96266-d9d0-4ead-b891-15fe1f5dca14'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.178808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e48f6cc0d14583b6f7b6d95560ba88', 'request_id': 'req-a8b96266-d9d0-4ead-b891-15fe1f5dca14'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.193150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e48f6cc0d14583b6f7b6d95560ba88', 'request_id': 'req-a8b96266-d9d0-4ead-b891-15fe1f5dca14'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.223863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] The token cache is being invalidate because project 53e48f6cc0d14583b6f7b6d95560ba88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:06:41.224157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.224833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a8b96266-d9d0-4ead-b891-15fe1f5dca14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.229871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 832/1652] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:06:40 2022] DELETE /identity/v3/projects/53e48f6cc0d14583b6f7b6d95560ba88 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:06:41.231366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:41.231822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:41.232100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:41.252570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:41.253898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:41.271154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbbc7b-3a82-4b4f-98d6-4cb02e396d8d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:41.276885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:41.277867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:41.278148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:41.278415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:41.288870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:41.305933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:41.322583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 833/1653] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:41.323775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:41.325377 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:41.338546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f3202-255c-46d1-9579-22ef7c40a114 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:41.345056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:41.345980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:41.346487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:41.346928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] PATH_INFO: `/v3/users/e30e9eaac92f4257988a660da582815c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:41.348290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30e9eaac92f4257988a660da582815c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:41.351048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:41.429623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30e9eaac92f4257988a660da582815c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.440560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:41.443088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:41.457821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30e9eaac92f4257988a660da582815c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.458703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30e9eaac92f4257988a660da582815c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.459380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30e9eaac92f4257988a660da582815c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.463468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 821/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:41.464836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:41.466523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:41.469939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30e9eaac92f4257988a660da582815c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:41.479328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff1a05-549f-4450-bdb5-0645c1b78004 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:41.484146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:41.485104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:41.485723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:41.486399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:41.489715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:41.496739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 834/1655] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:06:41 2022] DELETE /identity/v3/users/e30e9eaac92f4257988a660da582815c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:41.508297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:41.510151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3607e-a4b6-47be-9cb0-ced646273f2c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:41.522136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 822/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:43.318262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:43.322199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:43.519060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf50a05-adff-4954-91b6-3f0c17cb41c2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:43.531438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:43.532304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:43.532721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:43.533110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] PATH_INFO: `/v3/projects/25b55bb64ff447e5af6af2141659957b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:43.535434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b55bb64ff447e5af6af2141659957b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:43.539860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:43.644749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b55bb64ff447e5af6af2141659957b', 'request_id': 'req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:43.657804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b55bb64ff447e5af6af2141659957b', 'request_id': 'req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:43.679051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b55bb64ff447e5af6af2141659957b', 'request_id': 'req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:43.704547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:43.713721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] The token cache is being invalidate because project 25b55bb64ff447e5af6af2141659957b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:06:43.715430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:43.718477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-14d9eaf9-9e0f-4e82-a4f2-245cd2233ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:43.721711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 835/1657] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:06:43 2022] DELETE /identity/v3/projects/25b55bb64ff447e5af6af2141659957b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:43.726752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:43.727274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:43.727274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:43.766362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:43.767667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:43.816929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:43.908534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 823/1658] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:43.916065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:43.916368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:43.916649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:43.957445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:43.958601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:43.983001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 836/1659] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:43.986658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.007577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7de88-fe9b-424f-9e43-6d7e0f970fb6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:44.021744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:44.022450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:44.022719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:44.022993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:44.025638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:44.026338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:44.030786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:44.061654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 824/1660] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:44.066547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.079381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291bef-1213-4251-b7d3-b7a6a9330637 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:44.089982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:44.090693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:44.090973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:44.091399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:44.092043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:44.097649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:44.163203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 837/1661] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:44 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:44.167769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.182518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf364d-b4f3-48c3-b607-78fa339cddcf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:44.372063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:44.372764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:44.373072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:44.373371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:44.375434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:44.377919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:44.416928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.418774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:44.446499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b063494-3a7f-4837-aaa4-a14058862ba6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:44.455737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 825/1662] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:44 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:44.460039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:44.461009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.461745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:44.462023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:44.462342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] PATH_INFO: `/v3/projects/8776c6caa8fe4feeb03cef55f6670c44` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:44.463883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8776c6caa8fe4feeb03cef55f6670c44)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:44.467626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:44.490886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537dfd5-c66f-4f9d-bc54-69df71862519 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:44.512930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:44.513395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:44.513678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:44.513942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:44.520757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:44.526109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:44.567973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 826/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:44.568994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.573608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:44.609058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9b04-da00-4ff7-a779-9cec1e58b69c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:44.630225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8776c6caa8fe4feeb03cef55f6670c44', 'request_id': 'req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.655052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8776c6caa8fe4feeb03cef55f6670c44', 'request_id': 'req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.672401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8776c6caa8fe4feeb03cef55f6670c44', 'request_id': 'req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.704247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] The token cache is being invalidate because project 8776c6caa8fe4feeb03cef55f6670c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:06:44.704247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.704247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.709389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 838/1664] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:06:44 2022] DELETE /identity/v3/projects/8776c6caa8fe4feeb03cef55f6670c44 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:06:44.709389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:44.710937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:44.791787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:44.792471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:44.793273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:44.793537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] PATH_INFO: `/v3/projects/a8340758d70f486b85452807b3b9fff7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:44.795930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8340758d70f486b85452807b3b9fff7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:44.801875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:44.909064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:44.954958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8340758d70f486b85452807b3b9fff7', 'request_id': 'req-b6506d18-3e71-4b17-b2e7-1b8077a42b28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.979189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8340758d70f486b85452807b3b9fff7', 'request_id': 'req-b6506d18-3e71-4b17-b2e7-1b8077a42b28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:44.999568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e709f-c0ad-410e-9c7f-bdb93b0e0c67 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:45.002991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8340758d70f486b85452807b3b9fff7', 'request_id': 'req-b6506d18-3e71-4b17-b2e7-1b8077a42b28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.028094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] The token cache is being invalidate because project a8340758d70f486b85452807b3b9fff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:06:45.028428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.029157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b6506d18-3e71-4b17-b2e7-1b8077a42b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.036954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 827/1665] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:06:44 2022] DELETE /identity/v3/projects/a8340758d70f486b85452807b3b9fff7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:45.039780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.040126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.040452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.070371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:45.072324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.170077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c37d69-5d80-486d-8de6-d7971077bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:45.170849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c37d69-5d80-486d-8de6-d7971077bf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.171084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c37d69-5d80-486d-8de6-d7971077bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.171531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c37d69-5d80-486d-8de6-d7971077bf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.172179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c37d69-5d80-486d-8de6-d7971077bf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:45.175077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c37d69-5d80-486d-8de6-d7971077bf8f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:45.176679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:45.192332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 839/1666] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:45.192332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd00e-0d91-4933-9c94-25d234ae6e4a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.192332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd00e-0d91-4933-9c94-25d234ae6e4a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.192332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd00e-0d91-4933-9c94-25d234ae6e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.243414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8dbfd00e-0d91-4933-9c94-25d234ae6e4a None None] MFA Rules not processed for user `62400b08a4a64692a2dc43026f4a7986`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:45.244827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8dbfd00e-0d91-4933-9c94-25d234ae6e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.266191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 828/1667] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:45.266191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:45.266191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.294002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805444c-b12d-462a-b20d-30f5c30cb158 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:45.307300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:45.308064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.308436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.308820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] PATH_INFO: `/v3/users/87fc7bbd75f94a00b1775b982d6c6ce5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.310102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fc7bbd75f94a00b1775b982d6c6ce5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:45.316908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:45.420225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 840/1668] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:45.423586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13317-8fb0-4bfa-8159-866db68d1c9b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.424320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13317-8fb0-4bfa-8159-866db68d1c9b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.425244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13317-8fb0-4bfa-8159-866db68d1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.432403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fc7bbd75f94a00b1775b982d6c6ce5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.458830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fc7bbd75f94a00b1775b982d6c6ce5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.485350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fc7bbd75f94a00b1775b982d6c6ce5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.486502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fc7bbd75f94a00b1775b982d6c6ce5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.513681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-62d13317-8fb0-4bfa-8159-866db68d1c9b None None] MFA Rules not processed for user `45de14fdfb4347918b93e8871d718043`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:45.520285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-62d13317-8fb0-4bfa-8159-866db68d1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.523489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fc7bbd75f94a00b1775b982d6c6ce5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:45.535228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 829/1669] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:06:45 2022] DELETE /identity/v3/users/87fc7bbd75f94a00b1775b982d6c6ce5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:45.536309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:45.543884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.623047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:45.674734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 841/1670] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:45.676224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9572c2-093b-43b5-b078-2611bb90bcf6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.677474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9572c2-093b-43b5-b078-2611bb90bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.678716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9572c2-093b-43b5-b078-2611bb90bcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.698949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c184e-de9b-42d0-9884-8bfc77c48315 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:45.715843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:45.716685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.720429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.721953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] PATH_INFO: `/v3/projects/2f03e932df33490c8a791cffbca31fdd/users/c5e64648a6ae4e83974d86274ca66033/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.748816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3e9572c2-093b-43b5-b078-2611bb90bcf6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:45.750566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3e9572c2-093b-43b5-b078-2611bb90bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.766187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f03e932df33490c8a791cffbca31fdd, user_id=c5e64648a6ae4e83974d86274ca66033, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:45.768898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:45.773863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 842/1671] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:45.775391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:45.775516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:45.775692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:45.798391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 830/1672] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:45 2022] PUT /identity/v3/projects/2f03e932df33490c8a791cffbca31fdd/users/c5e64648a6ae4e83974d86274ca66033/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:45.799570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:45.818344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.844320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] MFA Rules not processed for user `62400b08a4a64692a2dc43026f4a7986`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:45.850767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:45.955680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 843/1673] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:45.963858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:45.981412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:46.068781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64321bd3-d7aa-4368-be8c-20fe6150a09d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:46.076893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:46.078959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.079246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.079550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.104869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf829a-6b63-4cd3-960e-ebac899466f1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:46.119431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:46.120874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.121378 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.122207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.126349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:46.126895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:46.129769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e9b2-b021-468d-a744-b405b62289a2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:46.172482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 844/1674] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:46.174705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408676-d8d6-48dd-9231-dbdff85471ee None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.176775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408676-d8d6-48dd-9231-dbdff85471ee None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.177319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408676-d8d6-48dd-9231-dbdff85471ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.250809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f8408676-d8d6-48dd-9231-dbdff85471ee None None] MFA Rules not processed for user `c5e64648a6ae4e83974d86274ca66033`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:46.252520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f8408676-d8d6-48dd-9231-dbdff85471ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:46.253126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:46.256364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:46.287179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 831/1675] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:46.288468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:46.293761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:46.336540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859848fb-14dc-4ffd-8264-a62748f26566 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:46.352898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:46.356091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.357845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.358254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.364162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:46.401024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:46.406006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:46.445546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 832/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:46.453723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 845/1677] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:46.462251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:46.464297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.464586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.464887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.510205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd454d1-735f-4f98-9bcc-ea1346a1c78e service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:46.531333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:46.531995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.532276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.532546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.533245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:46.535182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:46.569789 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] MFA Rules not processed for user `a3a98eacfbcd4825bf62913759682a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:46.575405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:46.630810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 833/1678] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:46 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:46.632049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:46.637941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:46.684188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:46.769145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a62f3-f50d-4461-a326-e6c975d55748 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:46.779323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:46.780059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:46.780403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:46.780740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:46.864706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 846/1679] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:46.866060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:46.882524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69fb06-4269-44cd-8a96-014452764a38 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:46.950609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:47.017825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:47.020685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:47.058268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:47.061228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.064259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.064447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 834/1680] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:47.064739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.065758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:47.066672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:47.069003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:47.079019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:47.150389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388d39f-9a3c-4679-83c9-009effe022c9 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:47.163709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 847/1681] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:46 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:47.169679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:47.181240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:47.181919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.182200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.182472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] PATH_INFO: `/v3/projects/33a0fffb253f4210b3d4f585f7fb6c30` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.187244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a0fffb253f4210b3d4f585f7fb6c30)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:47.189393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:47.352355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a0fffb253f4210b3d4f585f7fb6c30', 'request_id': 'req-db805ec0-b950-425e-b7c9-8b8a56109eaa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:47.378239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a0fffb253f4210b3d4f585f7fb6c30', 'request_id': 'req-db805ec0-b950-425e-b7c9-8b8a56109eaa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:47.394505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a0fffb253f4210b3d4f585f7fb6c30', 'request_id': 'req-db805ec0-b950-425e-b7c9-8b8a56109eaa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:47.428769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] The token cache is being invalidate because project 33a0fffb253f4210b3d4f585f7fb6c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:06:47.429102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:47.432869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:47.437056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 835/1682] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:06:47 2022] DELETE /identity/v3/projects/33a0fffb253f4210b3d4f585f7fb6c30 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:47.440491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:47.452692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:47.524302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d0503-538d-4e10-b3f2-bfa9065f383a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:47.623040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:47.633293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db805ec0-b950-425e-b7c9-8b8a56109eaa admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:47.646630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa72f5-b6ca-460f-987b-3fb29423a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:47.647895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa72f5-b6ca-460f-987b-3fb29423a344 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.648896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa72f5-b6ca-460f-987b-3fb29423a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.649313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa72f5-b6ca-460f-987b-3fb29423a344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.650711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa72f5-b6ca-460f-987b-3fb29423a344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:47.653744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa72f5-b6ca-460f-987b-3fb29423a344 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:47.679928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 836/1683] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:47.681694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.683956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.684379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.808403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:47.808403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:47.824043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 837/1684] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:47.825310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:47.850578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:47.853016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.854627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.854856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.859866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9f514-d54b-48e5-baa3-fe2fd0b23763 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:47.863600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:47.878111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed710cf2-4e01-442c-8326-8d0296576624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:47.878963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710cf2-4e01-442c-8326-8d0296576624 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.879414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710cf2-4e01-442c-8326-8d0296576624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.881186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710cf2-4e01-442c-8326-8d0296576624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.883138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed710cf2-4e01-442c-8326-8d0296576624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:47.893658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed710cf2-4e01-442c-8326-8d0296576624 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:47.931440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 838/1685] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:47.939490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:47.939921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:47.940202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:47.983148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:48.006448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:48.007686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:48.023063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:48.023063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be79d3-5733-49a5-99f6-b1a106059adb service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:48.039992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 839/1686] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:48.042151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:48.052702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 848/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 888 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:48.057992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac226870-2ddb-498f-82ce-8b7ded644e43 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.058274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac226870-2ddb-498f-82ce-8b7ded644e43 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.058548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac226870-2ddb-498f-82ce-8b7ded644e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.071319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8bee0-1d1b-487e-9e60-cdc463e606be None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:48.097164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:48.097851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.098122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.098404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] PATH_INFO: `/v3/projects/4ba4bc39e0a744b79eac7452bd8b7159/users/a43936cb1c5d4a8f90a4ccb3a420e3a5/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.129471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba4bc39e0a744b79eac7452bd8b7159, user_id=a43936cb1c5d4a8f90a4ccb3a420e3a5, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:48.132466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:48.136943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ac226870-2ddb-498f-82ce-8b7ded644e43 None None] MFA Rules not processed for user `05a4d967d13742998fab86f157e550c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:48.138394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ac226870-2ddb-498f-82ce-8b7ded644e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:48.165102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 840/1688] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:48 2022] PUT /identity/v3/projects/4ba4bc39e0a744b79eac7452bd8b7159/users/a43936cb1c5d4a8f90a4ccb3a420e3a5/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:48.166042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:48.331594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 849/1689] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:48.331594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.331594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.331594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.339223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db3d6-e539-4c9f-b368-0b7ea3092484 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:48.352468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:48.353546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.353911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.354635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.355322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:06:48.356004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:48.359893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a496f40-96cb-4e2c-829b-9401f30ccd52 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:48.390262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 841/1690] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:06:48.391581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eece-6cf1-427d-8bb1-96f4511288b0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.391872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eece-6cf1-427d-8bb1-96f4511288b0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.392153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413eece-6cf1-427d-8bb1-96f4511288b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.406045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] MFA Rules not processed for user `a43936cb1c5d4a8f90a4ccb3a420e3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:48.408403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:48.483467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3413eece-6cf1-427d-8bb1-96f4511288b0 None None] MFA Rules not processed for user `05a4d967d13742998fab86f157e550c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:48.486084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3413eece-6cf1-427d-8bb1-96f4511288b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:48.631472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 850/1691] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:48.638166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:48.652124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 842/1692] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:48.670607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3ac85-4821-4bf4-baff-92461b864b31 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.671749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3ac85-4821-4bf4-baff-92461b864b31 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.674343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3ac85-4821-4bf4-baff-92461b864b31 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.679616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 843/1693] 10.222.0.25 () {54 vars in 912 bytes} [Wed Aug 31 04:06:48 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:06:48.681352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3ac85-4821-4bf4-baff-92461b864b31 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:48.682492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a344d95-f25a-49dc-8099-1b7c1f7496f0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:48.691795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:48.695505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.700919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.701527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.703301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:48.709492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:48.732268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3ac85-4821-4bf4-baff-92461b864b31 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:48.746961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12f00-36c2-434a-9813-f3feaa36e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:48.747898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12f00-36c2-434a-9813-f3feaa36e644 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.748383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12f00-36c2-434a-9813-f3feaa36e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.748896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12f00-36c2-434a-9813-f3feaa36e644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:48.751948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c12f00-36c2-434a-9813-f3feaa36e644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:48.754138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c12f00-36c2-434a-9813-f3feaa36e644 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:48.801914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 851/1694] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:48 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:48.802719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:48.812033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:48.850944 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 844/1695] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:48 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:48.861487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:48.861803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:48.862035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.009228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:49.019796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:49.025388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:49.069933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:49.119125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6756d-3e92-4e2c-bb6d-b2a55244b97e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.170508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 845/1696] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:49.172579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.262967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.265329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.265746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.266297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.338334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747120f-9056-469f-b68e-49bf10140de7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.365053 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.365338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.365542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.365814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.366469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.370372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.386867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.389781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.403619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 852/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:49.405288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.422337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56ae55-e271-4626-a6ac-b3188dbf23da service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.446575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.447722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.448256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.448765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.450358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.451154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 846/1698] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:49 2022] POST /identity/v3/users => generated 279 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:49.452083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.453431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.459702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:49.506470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29dc87-be1a-4831-813b-728af68d6be0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.518400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 853/1699] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:49 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:49.519400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.519400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.519400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.519400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.523749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.540108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.541862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.553759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 847/1700] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:49.554944 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.558940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e0445-215f-4bf6-bd2f-bfe5e0df89ff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.571601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.572187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9503a-f6ee-4fdf-a7c9-9a4dac9152a3 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.573636 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.575677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.579596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.580641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.582674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.584955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.585684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.586055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.586734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.587952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.590148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.608681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 848/1701] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:49.616222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 854/1702] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:49.617955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.635972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.650128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522f92f-1fec-4272-9b6c-ddcf1860fa66 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.664757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.665558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.666029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.666518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.667421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.667564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f0695-7ec3-4d9d-93b8-f869efa67591 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.669240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.686415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.687233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.687515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.687785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] PATH_INFO: `/v3/projects/3c40050e331d4a19a808072dea69ad2a/users/b3fbbfe6d3bb4d29a806b57aebc38aa0/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.713861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 855/1703] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:49.717983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.740011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1246-fcef-49c9-a4dc-13a27222856f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.746152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c40050e331d4a19a808072dea69ad2a, user_id=b3fbbfe6d3bb4d29a806b57aebc38aa0, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.749991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.757076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dae380-00c5-4859-b01b-42d08e7bb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:49.758107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dae380-00c5-4859-b01b-42d08e7bb33f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.758494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dae380-00c5-4859-b01b-42d08e7bb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.759024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dae380-00c5-4859-b01b-42d08e7bb33f admin admin] PATH_INFO: `/v3/projects/40394520b929454b8874aab3f284d039/users/e1c4faaa07a849d3812d3a695544b9cd/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.778603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 849/1704] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:49 2022] PUT /identity/v3/projects/3c40050e331d4a19a808072dea69ad2a/users/b3fbbfe6d3bb4d29a806b57aebc38aa0/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:49.782273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:49.805631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dae380-00c5-4859-b01b-42d08e7bb33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40394520b929454b8874aab3f284d039, user_id=e1c4faaa07a849d3812d3a695544b9cd, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:49.812051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dae380-00c5-4859-b01b-42d08e7bb33f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:49.845946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 856/1705] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:49 2022] PUT /identity/v3/projects/40394520b929454b8874aab3f284d039/users/e1c4faaa07a849d3812d3a695544b9cd/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:06:49.857742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:49.858277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:49.858735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:49.934112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] MFA Rules not processed for user `e1c4faaa07a849d3812d3a695544b9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:49.936817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:49.943082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:49.968643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b0d99-b0d5-417f-8125-6df84c97a666 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:49.975167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:50.120711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.121382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.121657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.121926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.122586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.124512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.143319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 857/1706] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:50.144359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:50.156404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 850/1707] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:06:50.157512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:50.168272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99779bc8-fb8f-4503-9cb2-1af294d252af admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:50.180166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd86596-45a1-4670-a568-59afe5ef74e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.180909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd86596-45a1-4670-a568-59afe5ef74e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.181163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd86596-45a1-4670-a568-59afe5ef74e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.181429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd86596-45a1-4670-a568-59afe5ef74e1 admin admin] PATH_INFO: `/v3/projects/3c40050e331d4a19a808072dea69ad2a/users/b3fbbfe6d3bb4d29a806b57aebc38aa0/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.181604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135568d-bd04-4743-a093-2e87c07df4fc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:50.183584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd86596-45a1-4670-a568-59afe5ef74e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c40050e331d4a19a808072dea69ad2a, user_id=b3fbbfe6d3bb4d29a806b57aebc38aa0, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.186394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd86596-45a1-4670-a568-59afe5ef74e1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.199763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5ec5-a4af-4273-b358-6eea928603f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.203625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5ec5-a4af-4273-b358-6eea928603f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.204208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5ec5-a4af-4273-b358-6eea928603f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.204735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5ec5-a4af-4273-b358-6eea928603f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.205869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5ec5-a4af-4273-b358-6eea928603f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.210684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5ec5-a4af-4273-b358-6eea928603f5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.214973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 851/1708] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:50 2022] PUT /identity/v3/projects/3c40050e331d4a19a808072dea69ad2a/users/b3fbbfe6d3bb4d29a806b57aebc38aa0/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:06:50.225477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.225808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.226031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.306249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 858/1709] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:06:50 2022] POST /identity/v3/projects => generated 355 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:50.312033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.313042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.314090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.318374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] MFA Rules not processed for user `b3fbbfe6d3bb4d29a806b57aebc38aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:50.319815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:50.393000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] MFA Rules not processed for user `ba717b58c13d4bd7bd4b9399667345d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:50.396018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:50.469311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 852/1710] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:50.479391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:50.677336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 859/1711] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:50.679065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:50.680912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:50.714728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f87a-5140-4887-a8bf-d3496f8e3309 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:50.726235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.727315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.727775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.728374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.729242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.731981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.774075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 853/1712] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:06:50 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:06:50.778044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:50.790655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:50.812758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201e9fd-9a8a-433a-84ab-17f1c08e6a92 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:50.815961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3f482-6738-439a-807b-501c3b001c39 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:50.819758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.820418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.820696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.820993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.821808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.822781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.823616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.824668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.825709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.826185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.857313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 854/1713] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:06:50.858983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:50.883201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723e49-9a88-4f91-8a4c-2b670fe714d5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:50.893352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:50.901021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:50.901721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:50.901996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:50.902294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] PATH_INFO: `/v3/projects/502db6e58eab4566b0e56683404c2837/users/9c43e7e8e5ea4d8ab58dc207e4e6536e/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:50.939817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502db6e58eab4566b0e56683404c2837, user_id=9c43e7e8e5ea4d8ab58dc207e4e6536e, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.947006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.954729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:50.960055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:50.985022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 855/1714] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:50 2022] PUT /identity/v3/projects/502db6e58eab4566b0e56683404c2837/users/9c43e7e8e5ea4d8ab58dc207e4e6536e/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:50.986366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:51.026564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 860/1715] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:51.027778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:51.033889 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:51.119282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c90efc-4d2e-4151-8118-dddae5bd5172 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:51.134315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:51.134958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.135240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.135513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.136171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:51.137799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:51.159783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 856/1716] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:06:51.159783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:51.164981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:51.315167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92103fb-87d7-4a16-88de-37c531791d5d service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:51.328247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102123-abdc-4664-a538-e7191545ff6b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:51.340709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:51.341400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.341678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.341942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.345770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:51.371852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:51.373583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:51.390430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 857/1717] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:51.391547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:51.404960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d6891-294c-4a68-ad8f-4e52d67633fd service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:51.410565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488df67-8a35-4349-95db-ce2395994224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:51.411910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488df67-8a35-4349-95db-ce2395994224 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.412396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488df67-8a35-4349-95db-ce2395994224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.412943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488df67-8a35-4349-95db-ce2395994224 admin admin] PATH_INFO: `/v3/projects/502db6e58eab4566b0e56683404c2837/users/9c43e7e8e5ea4d8ab58dc207e4e6536e/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.415756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488df67-8a35-4349-95db-ce2395994224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502db6e58eab4566b0e56683404c2837, user_id=9c43e7e8e5ea4d8ab58dc207e4e6536e, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:51.418903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488df67-8a35-4349-95db-ce2395994224 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:51.448568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 858/1718] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:06:51 2022] PUT /identity/v3/projects/502db6e58eab4566b0e56683404c2837/users/9c43e7e8e5ea4d8ab58dc207e4e6536e/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:51.451833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22bc7-1ffe-4d56-8aea-f7efb635d89b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.452137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22bc7-1ffe-4d56-8aea-f7efb635d89b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.453638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd22bc7-1ffe-4d56-8aea-f7efb635d89b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.459596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 859/1719] 10.222.0.25 () {54 vars in 912 bytes} [Wed Aug 31 04:06:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:06:51.464480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.465473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.465813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.508874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a959672-711e-4d6f-893a-744c28b6c199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:51.509704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a959672-711e-4d6f-893a-744c28b6c199 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.512118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a959672-711e-4d6f-893a-744c28b6c199 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.512421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a959672-711e-4d6f-893a-744c28b6c199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.576259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] MFA Rules not processed for user `9c43e7e8e5ea4d8ab58dc207e4e6536e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:51.577567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:51.685986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:51.730913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a959672-711e-4d6f-893a-744c28b6c199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:51.734047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a959672-711e-4d6f-893a-744c28b6c199 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:51.759777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 861/1720] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:51.762538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:51.763530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:51.764606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:51.819353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:51.836071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:51.840068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:51.862450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 860/1721] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:51.875049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:51.981468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 862/1722] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:06:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:52.063745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:52.065296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:52.082866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ac9f-c052-4595-8d5d-f09eda1186d5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:52.093647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:52.094556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:52.094744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:52.094870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:52.114430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:52.115948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:52.119174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03af3-98c9-44ae-b336-ab2942a563f6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:52.131127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:52.132648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:52.133092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:52.133522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:52.150877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 863/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:06:52.159060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:52.160668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:52.197212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 861/1724] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:52.333346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:52.353954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44819c3b-cb62-403f-a856-ed5f0a3f686c service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:52.375368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e331-bc9c-42da-ad8d-772b41207384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:52.376945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e331-bc9c-42da-ad8d-772b41207384 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:52.377389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e331-bc9c-42da-ad8d-772b41207384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:52.378953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e331-bc9c-42da-ad8d-772b41207384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:52.544937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e331-bc9c-42da-ad8d-772b41207384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:52.547273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e331-bc9c-42da-ad8d-772b41207384 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:52.567987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 864/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:53.017542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:53.030801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450787f-7811-49b1-892d-cc110c7ea2ae service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:53.044525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02ddc5-b7a1-41bd-adf6-5c3b7b03b81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:53.048450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02ddc5-b7a1-41bd-adf6-5c3b7b03b81d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:53.048833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02ddc5-b7a1-41bd-adf6-5c3b7b03b81d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:53.051724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02ddc5-b7a1-41bd-adf6-5c3b7b03b81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:53.259397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b57e7d-7da6-4569-80fd-333706d209f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:53.259873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b57e7d-7da6-4569-80fd-333706d209f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:53.259963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b57e7d-7da6-4569-80fd-333706d209f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:53.366164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a8b57e7d-7da6-4569-80fd-333706d209f0 None None] MFA Rules not processed for user `45de14fdfb4347918b93e8871d718043`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:53.378482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a8b57e7d-7da6-4569-80fd-333706d209f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:53.425920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02ddc5-b7a1-41bd-adf6-5c3b7b03b81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:53.427328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02ddc5-b7a1-41bd-adf6-5c3b7b03b81d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:53.482145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 862/1726] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:06:53.747591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 865/1727] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:53.781117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f332860-9a4e-4aae-9c25-eb729539ec87 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:53.781408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f332860-9a4e-4aae-9c25-eb729539ec87 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:53.781683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f332860-9a4e-4aae-9c25-eb729539ec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:53.836219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3f332860-9a4e-4aae-9c25-eb729539ec87 None None] MFA Rules not processed for user `05a4d967d13742998fab86f157e550c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:53.844185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f332860-9a4e-4aae-9c25-eb729539ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:54.045078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 863/1728] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:54.785204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:54.785699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:54.785801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:54.821568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] MFA Rules not processed for user `a3a98eacfbcd4825bf62913759682a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:54.823114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:54.916264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:54.934151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 866/1729] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:55.500198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:55.501117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:55.501590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:55.527378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:55.596049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:55.599129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:55.863070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 864/1730] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:06:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:06:56.166541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:56.169593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:56.516292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3887cd-b641-4980-a85b-4d9be758cc18 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:56.530333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dbd98-ed70-4a6d-b6e2-28bd4bf6eb56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:56.531304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dbd98-ed70-4a6d-b6e2-28bd4bf6eb56 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:56.533114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dbd98-ed70-4a6d-b6e2-28bd4bf6eb56 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:56.534167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dbd98-ed70-4a6d-b6e2-28bd4bf6eb56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:56.559241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dbd98-ed70-4a6d-b6e2-28bd4bf6eb56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:56.564487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dbd98-ed70-4a6d-b6e2-28bd4bf6eb56 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:56.608998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 867/1731] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:06:58.534530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:58.775702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43397d7d-9a03-458c-a257-1482f3368d4d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:58.790723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:58.791507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:58.791794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:58.792210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] PATH_INFO: `/v3/users/a43936cb1c5d4a8f90a4ccb3a420e3a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:58.794145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43936cb1c5d4a8f90a4ccb3a420e3a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:58.796298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:58.913019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43936cb1c5d4a8f90a4ccb3a420e3a5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:58.936675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43936cb1c5d4a8f90a4ccb3a420e3a5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:58.949676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43936cb1c5d4a8f90a4ccb3a420e3a5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:58.950669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43936cb1c5d4a8f90a4ccb3a420e3a5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:58.981480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43936cb1c5d4a8f90a4ccb3a420e3a5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:06:58.984148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:06:58.995194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 865/1732] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:06:58 2022] DELETE /identity/v3/users/a43936cb1c5d4a8f90a4ccb3a420e3a5 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:06:59.000248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:59.000819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:59.001111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:59.063681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:06:59.069402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:59.200684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 868/1733] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:06:59.233953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:06:59.237674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:06:59.452652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4225-f5f3-4627-9072-40720b32140a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:06:59.462950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114a38e-cc91-4208-9caf-8bb1f9c67146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:06:59.464605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a38e-cc91-4208-9caf-8bb1f9c67146 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:06:59.466366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a38e-cc91-4208-9caf-8bb1f9c67146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:06:59.466548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a38e-cc91-4208-9caf-8bb1f9c67146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:06:59.491752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114a38e-cc91-4208-9caf-8bb1f9c67146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:06:59.493904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114a38e-cc91-4208-9caf-8bb1f9c67146 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:06:59.532839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 866/1734] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:00.333799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:00.336246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:00.368543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe1926-b3f6-448f-b9a4-fa80002bdadb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:00.399416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:00.400028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:00.400269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:00.434670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:00.435732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:00.436101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:00.436532 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] PATH_INFO: `/v3/projects/4ba4bc39e0a744b79eac7452bd8b7159` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:00.449844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba4bc39e0a744b79eac7452bd8b7159)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:00.485136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] MFA Rules not processed for user `ba717b58c13d4bd7bd4b9399667345d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:00.489441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:00.490156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:00.677657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba4bc39e0a744b79eac7452bd8b7159', 'request_id': 'req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:00.679666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 867/1735] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:00.735419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba4bc39e0a744b79eac7452bd8b7159', 'request_id': 'req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:00.741323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:00.754346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba4bc39e0a744b79eac7452bd8b7159', 'request_id': 'req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:00.784360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] The token cache is being invalidate because project 4ba4bc39e0a744b79eac7452bd8b7159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:00.784737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:00.786866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b733d19-e19c-48f3-a1e7-7dcf08e71d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:00.790292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 869/1736] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:00 2022] DELETE /identity/v3/projects/4ba4bc39e0a744b79eac7452bd8b7159 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:00.797846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:00.842312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79487545-2043-46ea-b6c3-36219d0becb8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:01.034381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:01.035219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:01.035734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:01.036195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] PATH_INFO: `/v3/users/b3fbbfe6d3bb4d29a806b57aebc38aa0` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:01.037650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fbbfe6d3bb4d29a806b57aebc38aa0)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:01.040930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:01.219587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fbbfe6d3bb4d29a806b57aebc38aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:01.223293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:01.242385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fbbfe6d3bb4d29a806b57aebc38aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:01.255011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fbbfe6d3bb4d29a806b57aebc38aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:01.256137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fbbfe6d3bb4d29a806b57aebc38aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:01.287370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fbbfe6d3bb4d29a806b57aebc38aa0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:01.305294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 868/1737] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:00 2022] DELETE /identity/v3/users/b3fbbfe6d3bb4d29a806b57aebc38aa0 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:03.726263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:03.728185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:03.728766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:03.775361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:03.779415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:03.940326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 870/1738] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 31 04:07:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:03.998136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:03.998749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:04.002196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:04.003585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:04.044534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a736b-2baa-498c-96c2-9f4fb9af1956 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:04.069196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e09c8-18ea-44c9-ade6-262c169d0ff2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:04.077324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:04.080678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:04.081436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:04.084640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:04.086017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab223-96c6-4c05-a9b8-1b9ecdaa15c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:04.087913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab223-96c6-4c05-a9b8-1b9ecdaa15c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:04.090112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab223-96c6-4c05-a9b8-1b9ecdaa15c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:04.093924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab223-96c6-4c05-a9b8-1b9ecdaa15c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:04.108829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:04.110970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:04.120344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ab223-96c6-4c05-a9b8-1b9ecdaa15c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:04.124963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 871/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:04.135635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ab223-96c6-4c05-a9b8-1b9ecdaa15c1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:04.180160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 869/1740] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:04.466986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:04.468790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:04.729075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9843a6-fe55-41a8-a1f3-1bd629790a55 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:04.750168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:04.750845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:04.753430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:04.753784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] PATH_INFO: `/v3/users/c5e64648a6ae4e83974d86274ca66033` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:04.758331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e64648a6ae4e83974d86274ca66033)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:04.776834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:04.872605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e64648a6ae4e83974d86274ca66033'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:04.911307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e64648a6ae4e83974d86274ca66033'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:04.912552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e64648a6ae4e83974d86274ca66033'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:04.913441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e64648a6ae4e83974d86274ca66033'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:04.922418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e64648a6ae4e83974d86274ca66033'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:04.938993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:04.945609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 872/1741] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:04 2022] DELETE /identity/v3/users/c5e64648a6ae4e83974d86274ca66033 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:04.950363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:04.953369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:04.953369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:05.012106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:05.014030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:05.235557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 870/1742] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:05.240328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:05.242222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:05.488152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bcaa3-16c7-4e96-86d8-caa84616eb54 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:05.500525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db81eb9-d5d1-489d-9ef6-335aeb143d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:05.506070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db81eb9-d5d1-489d-9ef6-335aeb143d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:05.506503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db81eb9-d5d1-489d-9ef6-335aeb143d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:05.508442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db81eb9-d5d1-489d-9ef6-335aeb143d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:05.558329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db81eb9-d5d1-489d-9ef6-335aeb143d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:05.568880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db81eb9-d5d1-489d-9ef6-335aeb143d94 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:05.600295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 873/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:06.501346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:06.502973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:06.531106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beac63-67c2-4f9c-9376-f72d0a1cb69e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:06.554216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:06.555566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:06.565448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:06.566153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] PATH_INFO: `/v3/projects/3c40050e331d4a19a808072dea69ad2a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:06.569362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c40050e331d4a19a808072dea69ad2a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:06.571545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:06.741955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c40050e331d4a19a808072dea69ad2a', 'request_id': 'req-50bfaa18-e00c-43af-98ed-637a502e1bcc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:06.771523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c40050e331d4a19a808072dea69ad2a', 'request_id': 'req-50bfaa18-e00c-43af-98ed-637a502e1bcc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:06.811932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c40050e331d4a19a808072dea69ad2a', 'request_id': 'req-50bfaa18-e00c-43af-98ed-637a502e1bcc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:06.868154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] The token cache is being invalidate because project 3c40050e331d4a19a808072dea69ad2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:06.872209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:06.887410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-50bfaa18-e00c-43af-98ed-637a502e1bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:06.901812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 871/1744] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:06 2022] DELETE /identity/v3/projects/3c40050e331d4a19a808072dea69ad2a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:06.902858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:06.903381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:06.903470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:06.958932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:06.960372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:07.188733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 874/1745] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:07.190764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.191469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.192116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.227453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:07.229099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:07.239217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 872/1746] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:07.243702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:07.263152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f284b-be09-42d6-8481-685ece4a0e0b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:07.278819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:07.279648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.280015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.280318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.285142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:07.285561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:07.287939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:07.336272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 875/1747] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:07.338296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:07.350528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef29c-154b-43a1-8a8f-5f6b5bd37e1a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:07.361481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:07.362832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.362832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.362832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.363458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:07.369326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:07.428579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 873/1748] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:07 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:07.429560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:07.444685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc07285-47e0-439d-9531-c7c0df4ec551 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:07.616216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:07.618265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:07.619235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:07.619873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.620159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.620435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.621121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:07.624334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:07.641313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a444c-a55e-401b-8067-670368e2a4a6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:07.652266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:07.654227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.655523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.656013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] PATH_INFO: `/v3/projects/2f03e932df33490c8a791cffbca31fdd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.659401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f03e932df33490c8a791cffbca31fdd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:07.663125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:07.678134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:07.682072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 876/1749] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:07 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:07.683671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:07.707232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2fa9-b52c-4502-ae0f-4eadb6b7d810 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:07.722554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:07.723316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.723810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.724086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.724764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:07.730028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:07.778175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 877/1750] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:07.782149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:07.808854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04136-248f-4a37-8088-f27430b78c46 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:07.811842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f03e932df33490c8a791cffbca31fdd', 'request_id': 'req-0bf36d42-6627-4096-9b2a-661f13058c4b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:07.820733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:07.830335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f03e932df33490c8a791cffbca31fdd', 'request_id': 'req-0bf36d42-6627-4096-9b2a-661f13058c4b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:07.849602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f03e932df33490c8a791cffbca31fdd', 'request_id': 'req-0bf36d42-6627-4096-9b2a-661f13058c4b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:07.864986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] The token cache is being invalidate because project 2f03e932df33490c8a791cffbca31fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:07.865649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:07.866608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0bf36d42-6627-4096-9b2a-661f13058c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:07.873142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 874/1751] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:07 2022] DELETE /identity/v3/projects/2f03e932df33490c8a791cffbca31fdd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:07.875240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98189ac-c9a5-4d58-a0d9-093efd14385d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.875824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98189ac-c9a5-4d58-a0d9-093efd14385d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.876319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98189ac-c9a5-4d58-a0d9-093efd14385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.902255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e98189ac-c9a5-4d58-a0d9-093efd14385d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:07.903783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e98189ac-c9a5-4d58-a0d9-093efd14385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:07.959453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:07.960745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:07.963268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:07.963579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:07.965807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:07.969749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.001678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 878/1752] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:08.004230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.008534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:08.069261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dad0a3-cd87-48a2-8510-b57b6a389219 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.093327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 875/1753] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:08.096484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.098184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.098609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4388c-f459-4beb-b23d-5021a804b93d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.098967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4388c-f459-4beb-b23d-5021a804b93d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.099428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.099920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4388c-f459-4beb-b23d-5021a804b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.100341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] PATH_INFO: `/v3/projects/1f6524405b4d40c294ab78a8cf328bec/users/7e22fe8d43184974b4768bc00770a9b8/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.164423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6524405b4d40c294ab78a8cf328bec, user_id=7e22fe8d43184974b4768bc00770a9b8, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.166517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7fd4388c-f459-4beb-b23d-5021a804b93d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:08.167781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7fd4388c-f459-4beb-b23d-5021a804b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:08.173449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.192061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 876/1754] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:08.195498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 879/1755] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:08 2022] PUT /identity/v3/projects/1f6524405b4d40c294ab78a8cf328bec/users/7e22fe8d43184974b4768bc00770a9b8/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:08.210799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.214789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.215850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.216169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.295712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] MFA Rules not processed for user `7e22fe8d43184974b4768bc00770a9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:08.301157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:08.485000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d9d02-90d8-4d30-b77b-9e9f2ed97134 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.503512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.504149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.504432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.504708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.505503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:08.505808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.509990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.520697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 877/1756] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:08.524919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.543701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa6d01-62dc-41cd-8823-4767a1714664 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.556837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.557473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 880/1757] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:08.558002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.558539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.559019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.559993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.561874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.565673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.590828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:08.602099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575c190-94e1-423d-9163-ab10e0919f7a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.617584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 878/1758] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:08 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:08.621893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.625596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.626244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.626570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.626859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.627652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.637948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.704412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 881/1759] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:08 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:08.708668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.809485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:08.825965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bd9fe-5515-441c-ae4b-4cb495f19a73 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.832128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.833285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.833833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.834307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.835233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.835372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a0f30-e3bf-4c44-9120-0416108605d7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.852337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.855224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.856037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.856388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.856721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.857577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.860160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.885106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 879/1760] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:08 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:08.894932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.922293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 882/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:08 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:08.926370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:08.939866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fa692-df1e-4639-be08-46c9d35fb3a9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.948397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45711769-a855-47e7-b8bb-c3f5e9b657db admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:08.962699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.963515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.963855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.964227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.965018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.966736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.972159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:08.973148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:08.975273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:08.975763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:08.976689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:08.984666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:08.989167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 883/1762] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:09.005287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:09.026336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78626357-ec18-42cd-92e0-566b9cf79fde admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:09.031990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 880/1763] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:09.033045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:09.046039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:09.047243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.047775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.048247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.050840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:09.053086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:09.061827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaaf5d-8459-4f08-a1a3-94f0c8739912 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:09.077353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:09.080196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 884/1764] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:09.083359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.084460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:09.085964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.086372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] PATH_INFO: `/v3/projects/6fddca118c704dc69b8a5a01df73bef7/users/f287389ec78c48f489698fbfd8bb417f/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.098518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fc69e-ade6-4ab1-9263-3ba2b8fb5e1a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:09.123190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de67f68-5d54-4574-a23d-3ef865a923ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:09.126920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fddca118c704dc69b8a5a01df73bef7, user_id=f287389ec78c48f489698fbfd8bb417f, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:09.127065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de67f68-5d54-4574-a23d-3ef865a923ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.127368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de67f68-5d54-4574-a23d-3ef865a923ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.127651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de67f68-5d54-4574-a23d-3ef865a923ab admin admin] PATH_INFO: `/v3/projects/c5233ace5c784e7ca0d4f004d05d3e76/users/473c98fc653d49faa67f7ef2c8a275cf/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.132935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:09.157474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de67f68-5d54-4574-a23d-3ef865a923ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5233ace5c784e7ca0d4f004d05d3e76, user_id=473c98fc653d49faa67f7ef2c8a275cf, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:09.161273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de67f68-5d54-4574-a23d-3ef865a923ab admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:09.198648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 881/1765] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:09 2022] PUT /identity/v3/projects/6fddca118c704dc69b8a5a01df73bef7/users/f287389ec78c48f489698fbfd8bb417f/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:09.203258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:09.280391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 885/1766] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:09 2022] PUT /identity/v3/projects/c5233ace5c784e7ca0d4f004d05d3e76/users/473c98fc653d49faa67f7ef2c8a275cf/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:09.284273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.285957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.286800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.357349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] MFA Rules not processed for user `473c98fc653d49faa67f7ef2c8a275cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:09.361225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:09.378599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b197fb-6c1d-4e04-9b12-7c537e5ba4a4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:09.502747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 886/1767] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:09.550470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:09.580869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d70fe-bb22-4f99-9089-989de8cfd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:09.582010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d70fe-bb22-4f99-9089-989de8cfd352 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.582408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d70fe-bb22-4f99-9089-989de8cfd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.582843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d70fe-bb22-4f99-9089-989de8cfd352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.583643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d70fe-bb22-4f99-9089-989de8cfd352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:09.585722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d70fe-bb22-4f99-9089-989de8cfd352 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:09.619541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:09.620557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 882/1768] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:09.634091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf48d0-f289-4bb9-9c06-3d779cf787ba None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:09.650105 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:09.651166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.651549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.651938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] PATH_INFO: `/v3/projects/6fddca118c704dc69b8a5a01df73bef7/users/f287389ec78c48f489698fbfd8bb417f/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.654171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fddca118c704dc69b8a5a01df73bef7, user_id=f287389ec78c48f489698fbfd8bb417f, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:09.660961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:09.700921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 887/1769] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:09 2022] PUT /identity/v3/projects/6fddca118c704dc69b8a5a01df73bef7/users/f287389ec78c48f489698fbfd8bb417f/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:09.710579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:09.713975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:09.714410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:09.751906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] MFA Rules not processed for user `f287389ec78c48f489698fbfd8bb417f`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:09.753472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:09.891354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 883/1770] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:09.902444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:09.904525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:10.058622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe182-154f-4874-b28c-47c7118fc76f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:10.065089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:10.065814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:10.066264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:10.066639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:10.096919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:10.098410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:10.110467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 888/1771] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:10.367924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:10.369526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:10.510054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817f420-6c4c-491c-8d78-7842935a59de None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:10.519450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:10.520530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:10.521374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:10.521842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:10.621337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:10.623521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:10.636849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 884/1772] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:10.700985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:10.715540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bad5fe-f198-4d05-9b7a-c9d1b8313049 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:10.733334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f287389ec78c48f489698fbfd8bb417f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fddca118c704dc69b8a5a01df73bef7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:10.734204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:10.734779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:10.735195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:10.736233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:10.736874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:10.742267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:10.770863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 889/1773] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:10.771982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:10.783605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fe76-9a02-4852-a629-6c32f4657652 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:10.801766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816160a-ec83-4e99-9c48-31a0865f4b63 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f287389ec78c48f489698fbfd8bb417f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fddca118c704dc69b8a5a01df73bef7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:10.807738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816160a-ec83-4e99-9c48-31a0865f4b63 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:10.808987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816160a-ec83-4e99-9c48-31a0865f4b63 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:10.809508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816160a-ec83-4e99-9c48-31a0865f4b63 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:10.811148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816160a-ec83-4e99-9c48-31a0865f4b63 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:10.813478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816160a-ec83-4e99-9c48-31a0865f4b63 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:10.831431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:10.862149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 885/1774] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:10 2022] POST /identity/v3/projects => generated 354 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:10.866577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:10.882099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:10.885639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256be4-3eaa-477a-ac2f-c17d407d8b26 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:10.885929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256be4-3eaa-477a-ac2f-c17d407d8b26 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:10.886214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d256be4-3eaa-477a-ac2f-c17d407d8b26 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:10.899623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921fd17-d21e-4f24-86bc-82089a53e716 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:10.911159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 886/1775] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:07:10 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:07:10.946652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d256be4-3eaa-477a-ac2f-c17d407d8b26 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:11.022812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f287389ec78c48f489698fbfd8bb417f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fddca118c704dc69b8a5a01df73bef7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:11.023936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:11.024427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:11.024937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:11.026420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:11.026882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:11.028668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735696b-ea5c-4ab9-a711-99b56db1100c tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:11.051978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 890/1776] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:11.057698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d256be4-3eaa-477a-ac2f-c17d407d8b26 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:11.058752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0fe87-3c3e-46dc-a6a0-d66013117407 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:11.059218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0fe87-3c3e-46dc-a6a0-d66013117407 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:11.059294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0fe87-3c3e-46dc-a6a0-d66013117407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:11.063425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:11.064232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:11.064707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:11.065232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] PATH_INFO: `/v3/users/473c98fc653d49faa67f7ef2c8a275cf` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:11.067411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473c98fc653d49faa67f7ef2c8a275cf)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:11.070384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:11.111649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f9d0fe87-3c3e-46dc-a6a0-d66013117407 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:11.117251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f9d0fe87-3c3e-46dc-a6a0-d66013117407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:11.156936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473c98fc653d49faa67f7ef2c8a275cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.167738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473c98fc653d49faa67f7ef2c8a275cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.177113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473c98fc653d49faa67f7ef2c8a275cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.177811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473c98fc653d49faa67f7ef2c8a275cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.207911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473c98fc653d49faa67f7ef2c8a275cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.222205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 887/1777] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:10 2022] DELETE /identity/v3/users/473c98fc653d49faa67f7ef2c8a275cf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:11.223208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:11.225945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:11.294128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 891/1778] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:07:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:11.296239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:11.296423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:11.296874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:11.332207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:11.333633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:11.385261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dabc1-8f4f-40f8-9728-d6f0c3a50ea4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:11.405949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f287389ec78c48f489698fbfd8bb417f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fddca118c704dc69b8a5a01df73bef7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:11.406687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:11.406876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:11.407253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] PATH_INFO: `/v3/projects/9c3a7454136d4f8d944a5efdbb491dd4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:11.408571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c3a7454136d4f8d944a5efdbb491dd4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:11.410699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:11.440994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:11.513643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3a7454136d4f8d944a5efdbb491dd4', 'request_id': 'req-c1437087-f1f6-4374-9f9f-c62682365f36'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.525732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3a7454136d4f8d944a5efdbb491dd4', 'request_id': 'req-c1437087-f1f6-4374-9f9f-c62682365f36'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.530341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 892/1779] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:11.539226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3a7454136d4f8d944a5efdbb491dd4', 'request_id': 'req-c1437087-f1f6-4374-9f9f-c62682365f36'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.554546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:11.554703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] The token cache is being invalidate because project 9c3a7454136d4f8d944a5efdbb491dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:11.554987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.556120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:11.556247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:11.558163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 888/1780] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:11 2022] DELETE /identity/v3/projects/9c3a7454136d4f8d944a5efdbb491dd4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:11.643507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:11.712656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f10f8f-48a2-4547-a1fd-f721e2806848 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:11.828206 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:11.829845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:11.859888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:11.861980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:11.862370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:11.862741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:11.867201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:12.008657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1437087-f1f6-4374-9f9f-c62682365f36 tempest-VolumeQuotaClassesTest-1238307407 tempest-VolumeQuotaClassesTest-1238307407-project-admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:12.022328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:12.022996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:12.024870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:12.025172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:12.029682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:12.031863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:12.036393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:12.055188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:12.057619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 893/1781] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:12.059274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:12.060532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8bf4f-3133-4a9a-ad31-e012c62b11ac service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:12.062459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:12.079959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbe6f-dded-46a3-b15c-dfba9c24028f service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:12.082486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 889/1782] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:12.102940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:12.104279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:12.104938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:12.105472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] PATH_INFO: `/v3/users/7e22fe8d43184974b4768bc00770a9b8` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:12.107849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e22fe8d43184974b4768bc00770a9b8)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:12.110543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:12.199880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e22fe8d43184974b4768bc00770a9b8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:12.224460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e22fe8d43184974b4768bc00770a9b8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:12.225268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e22fe8d43184974b4768bc00770a9b8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:12.226082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e22fe8d43184974b4768bc00770a9b8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:12.237147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e22fe8d43184974b4768bc00770a9b8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:12.268164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 894/1783] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:12 2022] DELETE /identity/v3/users/7e22fe8d43184974b4768bc00770a9b8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:12.271130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:12.271417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:12.271712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:12.312645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:12.314300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:12.379423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 890/1784] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:12.525011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:12.526511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:12.536655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:12.597542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f7478-7dee-49fa-9b90-3c25012efb92 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:12.601562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:12.602177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:12.602517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:12.602786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:12.614605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:12.616043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:12.629284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 895/1785] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:13.352063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:13.354314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.366705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fe027-5b84-4ffc-ba16-b275a23405b7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:13.371447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:13.372392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.372844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.373295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] PATH_INFO: `/v3/projects/c5233ace5c784e7ca0d4f004d05d3e76` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.374937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5233ace5c784e7ca0d4f004d05d3e76)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:13.377117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:13.408472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:13.447768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:13.450853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.451278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5233ace5c784e7ca0d4f004d05d3e76', 'request_id': 'req-8be138c8-1165-4a87-bec9-952a121861c9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.459467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5233ace5c784e7ca0d4f004d05d3e76', 'request_id': 'req-8be138c8-1165-4a87-bec9-952a121861c9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.471283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5233ace5c784e7ca0d4f004d05d3e76', 'request_id': 'req-8be138c8-1165-4a87-bec9-952a121861c9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.471480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73fd60-955c-478f-aee3-f7de3b61982c service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:13.486507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] The token cache is being invalidate because project c5233ace5c784e7ca0d4f004d05d3e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:13.486952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.487858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8be138c8-1165-4a87-bec9-952a121861c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.493067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 891/1786] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:13 2022] DELETE /identity/v3/projects/c5233ace5c784e7ca0d4f004d05d3e76 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:13.494832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551740a3-6dcf-491b-9495-385885e48167 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.495234 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551740a3-6dcf-491b-9495-385885e48167 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.495612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551740a3-6dcf-491b-9495-385885e48167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.527682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-551740a3-6dcf-491b-9495-385885e48167 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:13.529240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-551740a3-6dcf-491b-9495-385885e48167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.582852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:13.583835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.585407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.585923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] PATH_INFO: `/v3/users/e1c4faaa07a849d3812d3a695544b9cd` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.589170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c4faaa07a849d3812d3a695544b9cd)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:13.591376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:13.636170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 892/1787] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:13.643958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb4bb-6e8c-4cb3-b8ae-d4fe1482f35d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.644516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb4bb-6e8c-4cb3-b8ae-d4fe1482f35d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.645023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb4bb-6e8c-4cb3-b8ae-d4fe1482f35d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.647507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 893/1788] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:07:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:07:13.648877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48060-17c6-4067-91dc-a93232737911 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.649611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48060-17c6-4067-91dc-a93232737911 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.650136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48060-17c6-4067-91dc-a93232737911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.682016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-23a48060-17c6-4067-91dc-a93232737911 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:13.683771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-23a48060-17c6-4067-91dc-a93232737911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.685332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c4faaa07a849d3812d3a695544b9cd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.708595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c4faaa07a849d3812d3a695544b9cd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.709941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c4faaa07a849d3812d3a695544b9cd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.710715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c4faaa07a849d3812d3a695544b9cd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.721997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c4faaa07a849d3812d3a695544b9cd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:13.722807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 894/1789] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:13.725376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65a547-cf54-4d90-9635-9ec342b226e5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.727335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65a547-cf54-4d90-9635-9ec342b226e5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.727627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65a547-cf54-4d90-9635-9ec342b226e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.772598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 896/1790] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:13 2022] DELETE /identity/v3/users/e1c4faaa07a849d3812d3a695544b9cd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:13.781442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:13.785633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.795153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9f65a547-cf54-4d90-9635-9ec342b226e5 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:13.796987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f65a547-cf54-4d90-9635-9ec342b226e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.845543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:13.900825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b317d1-1508-4c95-ab1e-b30e9b89dd08 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:13.900825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:13.900825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.900825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.901312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.901312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:13.901479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:13.908044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 895/1791] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:07:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:13.908044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.908044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.908044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.915717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:13.940327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:13.942070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.942596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 897/1792] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:13.947847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:13.962043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 896/1793] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:13.988367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77450-6e68-4782-9a6a-26be3bde3c20 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:13.989911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:13.991748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:13.996174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:13.996174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:13.996174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:13.996493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:13.997252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.001882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.020424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc1ac-cffc-426c-9fb3-34845608226c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.031350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.033191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.034067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.034566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.048503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.050621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.070156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 898/1794] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:13 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:14.071821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.074164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.079148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 897/1795] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:14.081465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.113359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615dbf-5336-479a-80c3-aa362c2f8eb2 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.129330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:14.183090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdbb45-5e35-4ffe-8660-d0ef7679977a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.186978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.187713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.188219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.188569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.219635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.220259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.220533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.220833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.221689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.223869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.278066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 898/1796] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:14 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:14.279158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.284287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.297542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5eb27-8758-4de3-b5bf-647c42362d04 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.304091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.304968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.305329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.305851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] PATH_INFO: `/v3/projects/1f6524405b4d40c294ab78a8cf328bec` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.307200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6524405b4d40c294ab78a8cf328bec)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.309299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.319511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.322631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.339451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 899/1797] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:14.340393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.355874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac61cb-1fea-4b13-8bbc-517c2618716d service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.361930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.362904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.363265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.363604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.364336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.366111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.380380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 900/1798] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:14.384794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.390258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6524405b4d40c294ab78a8cf328bec', 'request_id': 'req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.399515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6524405b4d40c294ab78a8cf328bec', 'request_id': 'req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.400902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e97a8-3765-4fe7-a078-38a41b8868bd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.412126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6524405b4d40c294ab78a8cf328bec', 'request_id': 'req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.430028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] The token cache is being invalidate because project 1f6524405b4d40c294ab78a8cf328bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:14.430702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.431677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.433478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 899/1799] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:14 2022] DELETE /identity/v3/projects/1f6524405b4d40c294ab78a8cf328bec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:14.437877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.443993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.457798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:14.480278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.481006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.481443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.481863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.482665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.484276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.500564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 901/1800] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:14.502026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.505020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.521072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4b999-8add-4285-bef4-3529bce05fcc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.525138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddedbd-c1d5-4674-a1df-dbdd26b6636d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.527040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d55cd7-774b-42f0-b4a7-2321458f77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.527719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55cd7-774b-42f0-b4a7-2321458f77f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.527996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55cd7-774b-42f0-b4a7-2321458f77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.528265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55cd7-774b-42f0-b4a7-2321458f77f7 admin admin] PATH_INFO: `/v3/projects/6bbda3fd6cb74dcc9fbc8864405ebe96/users/4eac782a0f354f9188b859247a50b450/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.530326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.531232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.531581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.531925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] PATH_INFO: `/v3/users/f287389ec78c48f489698fbfd8bb417f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.533280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f287389ec78c48f489698fbfd8bb417f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.535528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.547800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d55cd7-774b-42f0-b4a7-2321458f77f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbda3fd6cb74dcc9fbc8864405ebe96, user_id=4eac782a0f354f9188b859247a50b450, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.550544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d55cd7-774b-42f0-b4a7-2321458f77f7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.579151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 902/1801] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:14 2022] PUT /identity/v3/projects/6bbda3fd6cb74dcc9fbc8864405ebe96/users/4eac782a0f354f9188b859247a50b450/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:14.580450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:14.581193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.582158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.582437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.600478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f287389ec78c48f489698fbfd8bb417f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.609756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f287389ec78c48f489698fbfd8bb417f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.611781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:14.613280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.621309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f287389ec78c48f489698fbfd8bb417f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.622008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f287389ec78c48f489698fbfd8bb417f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.650995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f287389ec78c48f489698fbfd8bb417f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:14.662425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 900/1802] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:14 2022] DELETE /identity/v3/users/f287389ec78c48f489698fbfd8bb417f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:14.691168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 903/1803] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:14.712143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.714720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.796633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da901-2007-475e-b669-90aa1aa969ef admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.801532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.802346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.802688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.803023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.875038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:14.877121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:14.893898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d8340-ce1a-446d-9d3c-989d4ff6d9a6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:14.943034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.944517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:14.965328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 901/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:14.970954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:14.971896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:14.972379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:14.972901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] PATH_INFO: `/v3/projects/40394520b929454b8874aab3f284d039` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:14.974314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40394520b929454b8874aab3f284d039)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:14.976628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.043382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40394520b929454b8874aab3f284d039', 'request_id': 'req-2d7ad682-c1ec-4a3f-8116-247090b7340c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.050568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40394520b929454b8874aab3f284d039', 'request_id': 'req-2d7ad682-c1ec-4a3f-8116-247090b7340c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.051975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:15.058727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40394520b929454b8874aab3f284d039', 'request_id': 'req-2d7ad682-c1ec-4a3f-8116-247090b7340c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.093912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.095360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:15.110125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] The token cache is being invalidate because project 40394520b929454b8874aab3f284d039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:15.110595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.111522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.113847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 904/1805] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:14 2022] DELETE /identity/v3/projects/40394520b929454b8874aab3f284d039 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:15.118439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.120845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:15.121387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19972406-4aa0-4fd9-9dbd-983970ea5db4 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.195205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:15.206844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.207606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.207911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.208221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] PATH_INFO: `/v3/projects/6fddca118c704dc69b8a5a01df73bef7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.209573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fddca118c704dc69b8a5a01df73bef7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.212659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.231002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad682-c1ec-4a3f-8116-247090b7340c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.237937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.239594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.240081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.240530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] PATH_INFO: `/v3/users/9c43e7e8e5ea4d8ab58dc207e4e6536e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.241752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c43e7e8e5ea4d8ab58dc207e4e6536e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.243857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.280379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fddca118c704dc69b8a5a01df73bef7', 'request_id': 'req-4733e612-0598-4ec3-b7ec-13fd38d6ba38'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.294117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fddca118c704dc69b8a5a01df73bef7', 'request_id': 'req-4733e612-0598-4ec3-b7ec-13fd38d6ba38'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.313149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fddca118c704dc69b8a5a01df73bef7', 'request_id': 'req-4733e612-0598-4ec3-b7ec-13fd38d6ba38'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.320246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c43e7e8e5ea4d8ab58dc207e4e6536e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.335424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] The token cache is being invalidate because project 6fddca118c704dc69b8a5a01df73bef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:15.336274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.337639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4733e612-0598-4ec3-b7ec-13fd38d6ba38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.343102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 902/1806] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:15 2022] DELETE /identity/v3/projects/6fddca118c704dc69b8a5a01df73bef7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:15.345747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.346045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.346250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.346814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c43e7e8e5ea4d8ab58dc207e4e6536e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.347675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c43e7e8e5ea4d8ab58dc207e4e6536e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.348296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c43e7e8e5ea4d8ab58dc207e4e6536e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.358104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e02b51c1-4a68-450a-b710-563ceb079f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c43e7e8e5ea4d8ab58dc207e4e6536e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:15.369661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:15.375013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:15.380396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 905/1807] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:15 2022] DELETE /identity/v3/users/9c43e7e8e5ea4d8ab58dc207e4e6536e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:15.448725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 903/1808] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:15.457036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.457982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.459043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.485912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:15.487647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:15.497474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 906/1809] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:15.502414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.515415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b9063-74db-4564-9c4c-1ba10a33ee41 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.522191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.522899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.523442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.523564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.524286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:15.524719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.526675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.561763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 904/1810] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:15.566725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.581431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8a02-7ab1-4445-b6b0-f3c84c9f2aa9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.594161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.595082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.595637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.596288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.601658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.604917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.658608 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 907/1811] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:15 2022] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:15.661765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.672768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b353ba8-9a50-4b60-b05f-95d38bf43d35 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.740743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.742296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.742296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.742546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.743453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.745610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.771533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 905/1812] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:15 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:15.776052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.787590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca6011-6979-477b-b51a-c272adcfec13 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.792347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.793098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.793445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.793787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.794504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.796228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.812458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.813010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 908/1813] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:15.818747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:15.826871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9678792-001a-4906-abc1-192d06487c93 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.834718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5e44-dc1f-41e2-87c3-9da33caa0176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.835285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5e44-dc1f-41e2-87c3-9da33caa0176 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.835630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5e44-dc1f-41e2-87c3-9da33caa0176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.836766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5e44-dc1f-41e2-87c3-9da33caa0176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.836766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5e44-dc1f-41e2-87c3-9da33caa0176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.838477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5e44-dc1f-41e2-87c3-9da33caa0176 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.854994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.856085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 906/1814] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:15.866392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9e47-5e98-4618-afaa-0a89a4cea825 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:15.871438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:15.872184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.872560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.872933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] PATH_INFO: `/v3/projects/f3f5c389bc694a03a71ee0e197e297ca/users/3ac4187a31954fa9892ecc747f68a1bc/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.902354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f5c389bc694a03a71ee0e197e297ca, user_id=3ac4187a31954fa9892ecc747f68a1bc, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:15.905640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:15.918840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:15.927395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 909/1815] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:15 2022] PUT /identity/v3/projects/f3f5c389bc694a03a71ee0e197e297ca/users/3ac4187a31954fa9892ecc747f68a1bc/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:15.939406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df74b1-223b-47a7-89a4-c55ff1eb4047 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:15.939406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df74b1-223b-47a7-89a4-c55ff1eb4047 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:15.939626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df74b1-223b-47a7-89a4-c55ff1eb4047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:15.965492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:15.967725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:15.981714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-17df74b1-223b-47a7-89a4-c55ff1eb4047 None None] MFA Rules not processed for user `3ac4187a31954fa9892ecc747f68a1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:15.984577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-17df74b1-223b-47a7-89a4-c55ff1eb4047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:16.061052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4efcc-d31b-476b-8aad-be8cd28097e3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.070629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.071318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.071612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.071916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] PATH_INFO: `/v3/projects/502db6e58eab4566b0e56683404c2837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.073111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502db6e58eab4566b0e56683404c2837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.076172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.077452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 907/1816] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:16.078770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8704c15-e892-4d02-82ed-b9521bb44a8d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.079052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8704c15-e892-4d02-82ed-b9521bb44a8d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.079322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8704c15-e892-4d02-82ed-b9521bb44a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.109770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a8704c15-e892-4d02-82ed-b9521bb44a8d None None] MFA Rules not processed for user `4eac782a0f354f9188b859247a50b450`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:16.111081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a8704c15-e892-4d02-82ed-b9521bb44a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:16.142941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502db6e58eab4566b0e56683404c2837', 'request_id': 'req-b927d932-2c34-4ce6-965e-6dc75151afb2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:16.151050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502db6e58eab4566b0e56683404c2837', 'request_id': 'req-b927d932-2c34-4ce6-965e-6dc75151afb2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:16.161471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502db6e58eab4566b0e56683404c2837', 'request_id': 'req-b927d932-2c34-4ce6-965e-6dc75151afb2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:16.187084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] The token cache is being invalidate because project 502db6e58eab4566b0e56683404c2837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:16.187376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:16.190511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:16.194009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 910/1817] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:15 2022] DELETE /identity/v3/projects/502db6e58eab4566b0e56683404c2837 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:16.194927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.197640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:16.234109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 908/1818] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:16.235820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.236111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.236386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.259113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:16.260441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:16.358110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927d932-2c34-4ce6-965e-6dc75151afb2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.373175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 909/1819] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:16.375094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.378330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef39139-5b8d-4693-a23c-ab768df598ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.379030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef39139-5b8d-4693-a23c-ab768df598ff admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.379336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef39139-5b8d-4693-a23c-ab768df598ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.379611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef39139-5b8d-4693-a23c-ab768df598ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.379826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:16.383949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef39139-5b8d-4693-a23c-ab768df598ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.387298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef39139-5b8d-4693-a23c-ab768df598ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.405127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a0cb3-371d-49e4-86e0-c31ddfe808c8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.411711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.413191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.413505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.413792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.414483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.417562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.431949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:16.448496 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 911/1820] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/projects => generated 399 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:16.449927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.450211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.450514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.459277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 910/1821] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/projects => generated 403 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:16.460782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.470664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:16.471876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:16.490664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:16.542611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820d975-270a-4460-bd79-bd28f178fc43 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.547545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.548166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.548449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.548719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.550048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.551994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.568843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 912/1822] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:16.569817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.581502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 911/1823] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/users => generated 306 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:16.582221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eb00c-a327-49b5-a856-dcc366c87ce3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.582437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.587804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.588425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.588712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.589026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.589697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.591741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.593944 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d27879-aec9-46fe-a6ad-0a456c783cb6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.598646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.599245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.599526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.599802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.600450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:16.600754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.602644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.615367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 913/1824] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/users => generated 308 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:16.616609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.617113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 912/1825] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:16.621294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.627965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9cf0c-0f97-4c56-9254-ff6cbe2266a4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.631727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108c394-e568-479f-bfa0-306e7381acff admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.634116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.634732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.635015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.635295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.635973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.636839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.637433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.637608 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.637827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.640528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.640528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.640764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.651576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 914/1826] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:16.651576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.662347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa83e72-294d-4f2e-9f86-57de95faa2f4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.669245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.669859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.670143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.670421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.671070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.675360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 913/1827] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:16.675645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.675730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.685043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 915/1828] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:16.685924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.700456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae9f70-15f7-435b-b4b1-deac044b4007 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.758010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90566d9-725e-469f-82de-d55e46d6609e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.767022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.767330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.767715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.767947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.768039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.768227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.768327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] PATH_INFO: `/v3/projects/9180408205664ec2a6accf1a17d355bf/users/981f91ee6d4b491cbc2c0e6e3db61f31/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.768498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.769170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.771075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.783381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9180408205664ec2a6accf1a17d355bf, user_id=981f91ee6d4b491cbc2c0e6e3db61f31, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.786160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.797098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 916/1829] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:16 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:16.797943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.799085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 914/1830] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:16 2022] PUT /identity/v3/projects/9180408205664ec2a6accf1a17d355bf/users/981f91ee6d4b491cbc2c0e6e3db61f31/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:16.802127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.809442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b0966-90d7-4505-94cd-0ece0b274789 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.834500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:16.866536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.867208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.867485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.867736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0402-54a7-456a-824c-220a045b938f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.868009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] PATH_INFO: `/v3/projects/273e7aa6df9e48f28dd9df535409ffea/users/f38d97e979e843dca6d231e2dcf7b1b0/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.872486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.873120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.873397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.873669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.874620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.876221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.877073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:16.889441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 915/1831] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:16.889441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.889739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273e7aa6df9e48f28dd9df535409ffea, user_id=f38d97e979e843dca6d231e2dcf7b1b0, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.890276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.897856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159bccc-3a99-4bd5-b027-50f06b8b4252 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:16.903096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:16.903774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:16.904046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:16.904414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:16.905029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:16.909353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 917/1832] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:16 2022] PUT /identity/v3/projects/273e7aa6df9e48f28dd9df535409ffea/users/f38d97e979e843dca6d231e2dcf7b1b0/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:16.909508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:16.909619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.924566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 916/1833] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:16.925220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:16.936694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f48d4-d345-4a80-bfb3-1e2dc49ce936 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.010996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9b74a-200c-4f0c-84c0-d802673254f4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.011619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.012391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.012777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.013092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.013735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.015646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.017698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.018487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.018933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.019356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.020153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.022535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.027573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 917/1834] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:17.028649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.036446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 918/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:17.037609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.039377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc82777-c1a1-4054-9c38-5517eb32694f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.044838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.045838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.046120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.046398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] PATH_INFO: `/v3/projects/9180408205664ec2a6accf1a17d355bf/users/981f91ee6d4b491cbc2c0e6e3db61f31/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.048686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9180408205664ec2a6accf1a17d355bf, user_id=981f91ee6d4b491cbc2c0e6e3db61f31, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.051325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb46c8a-5f93-46e8-aee4-0c795f675b8e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.051591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.059104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759c5-fdce-4f91-831d-e5dda10b5747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.059982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759c5-fdce-4f91-831d-e5dda10b5747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.060091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759c5-fdce-4f91-831d-e5dda10b5747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.060378 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759c5-fdce-4f91-831d-e5dda10b5747 admin admin] PATH_INFO: `/v3/projects/273e7aa6df9e48f28dd9df535409ffea/users/f38d97e979e843dca6d231e2dcf7b1b0/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.062484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759c5-fdce-4f91-831d-e5dda10b5747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273e7aa6df9e48f28dd9df535409ffea, user_id=f38d97e979e843dca6d231e2dcf7b1b0, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.065827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759c5-fdce-4f91-831d-e5dda10b5747 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.076884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 918/1836] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:17 2022] PUT /identity/v3/projects/9180408205664ec2a6accf1a17d355bf/users/981f91ee6d4b491cbc2c0e6e3db61f31/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:17.078046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.086328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 919/1837] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:17 2022] PUT /identity/v3/projects/273e7aa6df9e48f28dd9df535409ffea/users/f38d97e979e843dca6d231e2dcf7b1b0/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:17.087916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.088244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.088517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.132634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] MFA Rules not processed for user `981f91ee6d4b491cbc2c0e6e3db61f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:17.134025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:17.175880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8e286-cfae-41c5-8d7e-b8b798f73fb6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.209784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 920/1838] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:17 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:17.220603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.222147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:17.226498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:17.248054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c6040-6e6e-4aaa-acec-7d2392045591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.248750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c6040-6e6e-4aaa-acec-7d2392045591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.249392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c6040-6e6e-4aaa-acec-7d2392045591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.249682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c6040-6e6e-4aaa-acec-7d2392045591 admin admin] PATH_INFO: `/v3/projects/bcf963d1108e44ef9c189af5bc6f4cf9/users/97aec507d2f84924b86e19a30a172525/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.275687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c6040-6e6e-4aaa-acec-7d2392045591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf963d1108e44ef9c189af5bc6f4cf9, user_id=97aec507d2f84924b86e19a30a172525, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.279504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c6040-6e6e-4aaa-acec-7d2392045591 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.289288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e3e5-20aa-4480-a800-feb87ba591b2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.294190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 919/1839] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:17 2022] PUT /identity/v3/projects/bcf963d1108e44ef9c189af5bc6f4cf9/users/97aec507d2f84924b86e19a30a172525/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:17.304590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:17.304780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.305068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.305404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.334920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] MFA Rules not processed for user `97aec507d2f84924b86e19a30a172525`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:17.336253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:17.353646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.354875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.355766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.357242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.404290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 920/1840] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:17.410927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.433669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.435662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.457263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 921/1841] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:17 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:07:17.498110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a91f15-9dfc-4528-9eb4-493f307668fa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.513222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.513903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.514183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.514571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.515106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.520657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.542495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.565536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c19c-9690-4d73-8386-641e5dc80fe1 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.570356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.571226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.571510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.571783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.573768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:17.600493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 921/1842] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:17 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:17.604946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.658328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.660861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.673342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 922/1843] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:17 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:17.699622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:17.733917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668099e-b8a0-4759-a16f-8888d8021aa0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.743743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.744470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.744895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.746592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.747375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.750095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.787730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 922/1844] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:17 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:17.791938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.805417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37e8f-05cd-4ec5-8b6d-644384617dae service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.812694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.814026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.814312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.814583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.816288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.818851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.836951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 923/1845] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:17.840519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.851939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae841dd-f442-49b5-81fe-2726002ea766 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.858133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab62f1-d5f7-4476-b3a6-1cef0bdb917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.858882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab62f1-d5f7-4476-b3a6-1cef0bdb917a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.859247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab62f1-d5f7-4476-b3a6-1cef0bdb917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.860723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab62f1-d5f7-4476-b3a6-1cef0bdb917a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.861231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab62f1-d5f7-4476-b3a6-1cef0bdb917a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.863387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab62f1-d5f7-4476-b3a6-1cef0bdb917a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.882193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:17.888745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 923/1846] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:17.896830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05344b1-70a2-4ce9-8477-c0a9f01c58f9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:17.902492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb0ab2-158f-4ee1-9c38-da7c356a91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:17.903365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0ab2-158f-4ee1-9c38-da7c356a91c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.903706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0ab2-158f-4ee1-9c38-da7c356a91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.904046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb0ab2-158f-4ee1-9c38-da7c356a91c6 admin admin] PATH_INFO: `/v3/projects/b238de8ff65440b4884efee422aee4a5/users/8080c3a6ab4440f4b1abff11e721a364/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:17.923068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb0ab2-158f-4ee1-9c38-da7c356a91c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b238de8ff65440b4884efee422aee4a5, user_id=8080c3a6ab4440f4b1abff11e721a364, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:17.930706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb0ab2-158f-4ee1-9c38-da7c356a91c6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:17.962795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 924/1847] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:17 2022] PUT /identity/v3/projects/b238de8ff65440b4884efee422aee4a5/users/8080c3a6ab4440f4b1abff11e721a364/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:17.966055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:17.966331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:17.966630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.035574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] MFA Rules not processed for user `8080c3a6ab4440f4b1abff11e721a364`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:18.036853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:18.070053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.070256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.070603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.104859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] MFA Rules not processed for user `f38d97e979e843dca6d231e2dcf7b1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:18.106451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:18.136069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:18.246732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 924/1848] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:18.248188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:18.267677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 925/1849] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:18.339843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f44dc-9b1c-44a1-9a94-3e2007969039 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:18.352336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:18.353401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.354426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.354980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.356000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:18.358497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:18.410407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 925/1850] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:18 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:18.414791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:18.425553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017f8b2-1e12-4489-af76-c50b71d3d467 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:18.482629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:18.483383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.483588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.483779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.484565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:18.486867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:18.511555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 926/1851] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:18 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:18.524663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:18.540867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1bf9-3e4a-4ede-8226-c55ce05a7a58 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:18.546347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:18.547570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.547920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.548267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.549034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:18.552549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:18.563122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 926/1852] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:18.567183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:18.584977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81173e-bf63-4316-915b-18a3414c8c0d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:18.589774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:18.590932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.591443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.591904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] PATH_INFO: `/v3/projects/9f796f94cbea489baaa7e45ccfa9d8f2/users/455c51b073a342b89ca3ba1eb7b31360/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.609457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f796f94cbea489baaa7e45ccfa9d8f2, user_id=455c51b073a342b89ca3ba1eb7b31360, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:18.612123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:18.629235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 927/1853] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:18 2022] PUT /identity/v3/projects/9f796f94cbea489baaa7e45ccfa9d8f2/users/455c51b073a342b89ca3ba1eb7b31360/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:18.633272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:18.643440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2cbc-da44-4ce6-95e2-f410507a8532 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:18.668341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:18.717108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6951b-5ac3-4293-93e3-b7786a67ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:18.717912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6951b-5ac3-4293-93e3-b7786a67ae4d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.718318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6951b-5ac3-4293-93e3-b7786a67ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.718636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6951b-5ac3-4293-93e3-b7786a67ae4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.719413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6951b-5ac3-4293-93e3-b7786a67ae4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:18.720970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6951b-5ac3-4293-93e3-b7786a67ae4d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:18.732607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 927/1854] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:18.736535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:18.748066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89841f38-42ab-4835-a4e0-b048477e1276 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:18.753744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:18.754425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.754840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.755119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] PATH_INFO: `/v3/projects/9f796f94cbea489baaa7e45ccfa9d8f2/users/455c51b073a342b89ca3ba1eb7b31360/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.757217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f796f94cbea489baaa7e45ccfa9d8f2, user_id=455c51b073a342b89ca3ba1eb7b31360, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:18.759954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:18.771864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 928/1855] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:18 2022] PUT /identity/v3/projects/9f796f94cbea489baaa7e45ccfa9d8f2/users/455c51b073a342b89ca3ba1eb7b31360/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:18.782765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e865d-c2fe-46d2-9053-670925fc80ad None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:18.783056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e865d-c2fe-46d2-9053-670925fc80ad None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:18.783498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e865d-c2fe-46d2-9053-670925fc80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:18.816358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5d4e865d-c2fe-46d2-9053-670925fc80ad None None] MFA Rules not processed for user `455c51b073a342b89ca3ba1eb7b31360`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:18.817626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d4e865d-c2fe-46d2-9053-670925fc80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:18.983257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 928/1856] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:18.992693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:19.049707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b518-c1c0-4e7d-9b7e-58fb3cca53c9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:19.053207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba5761-3479-4006-bc2b-ad030f2cb1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:19.053807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba5761-3479-4006-bc2b-ad030f2cb1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:19.054087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba5761-3479-4006-bc2b-ad030f2cb1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:19.054352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba5761-3479-4006-bc2b-ad030f2cb1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:19.063336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba5761-3479-4006-bc2b-ad030f2cb1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:19.064749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba5761-3479-4006-bc2b-ad030f2cb1d9 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:19.074699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 929/1857] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:19.452379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9de67-3d0e-4caf-a8be-2efbdf2dfadb None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:19.452861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9de67-3d0e-4caf-a8be-2efbdf2dfadb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:19.453102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9de67-3d0e-4caf-a8be-2efbdf2dfadb None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:19.454902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 929/1858] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:07:19.470320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:19.471163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:19.471670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:19.484146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:19.498444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:19.500939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:19.697692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 930/1859] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:07:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:19.763156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9de67-3d0e-4caf-a8be-2efbdf2dfadb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:19.765228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6d9de67-3d0e-4caf-a8be-2efbdf2dfadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:19.786320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9de67-3d0e-4caf-a8be-2efbdf2dfadb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:19.792617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe477b-f281-44f8-b61c-af1b4c76aa29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:19.793370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe477b-f281-44f8-b61c-af1b4c76aa29 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:19.793705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe477b-f281-44f8-b61c-af1b4c76aa29 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:19.794047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe477b-f281-44f8-b61c-af1b4c76aa29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:19.808163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:19.812220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe477b-f281-44f8-b61c-af1b4c76aa29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:19.814683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe477b-f281-44f8-b61c-af1b4c76aa29 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:19.823633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fc67f-fe8a-4964-92a5-d2b5d9790a7b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:19.828486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c569c1f-5d53-46c9-8b3e-29ee04a90bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:19.829400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569c1f-5d53-46c9-8b3e-29ee04a90bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:19.829775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569c1f-5d53-46c9-8b3e-29ee04a90bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:19.829972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 930/1860] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:19.830222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c569c1f-5d53-46c9-8b3e-29ee04a90bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:19.926796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569c1f-5d53-46c9-8b3e-29ee04a90bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:19.929645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c569c1f-5d53-46c9-8b3e-29ee04a90bf5 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:19.942405 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 931/1861] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:20.164074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea19dc-9bda-45a2-9cb5-02f7f963a28c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.164370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea19dc-9bda-45a2-9cb5-02f7f963a28c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.164702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea19dc-9bda-45a2-9cb5-02f7f963a28c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.166415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 931/1862] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:07:20.188924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295478-8b86-4f0b-9127-d82bcdf61797 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.189833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295478-8b86-4f0b-9127-d82bcdf61797 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.190525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73295478-8b86-4f0b-9127-d82bcdf61797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.223142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-73295478-8b86-4f0b-9127-d82bcdf61797 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:20.224706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-73295478-8b86-4f0b-9127-d82bcdf61797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:20.350617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 932/1863] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:07:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:20.369084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea19dc-9bda-45a2-9cb5-02f7f963a28c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:20.371075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f5ea19dc-9bda-45a2-9cb5-02f7f963a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:20.402904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea19dc-9bda-45a2-9cb5-02f7f963a28c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:20.410704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19d3de-1144-40a4-b81b-3df7ba5bba96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:20.411559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d3de-1144-40a4-b81b-3df7ba5bba96 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.413313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d3de-1144-40a4-b81b-3df7ba5bba96 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.413638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d3de-1144-40a4-b81b-3df7ba5bba96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.425199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19d3de-1144-40a4-b81b-3df7ba5bba96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:20.426982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19d3de-1144-40a4-b81b-3df7ba5bba96 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:20.439019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 932/1864] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:20.518428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f1e00-d81e-4244-9aa9-be39a55f12a6 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.518820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f1e00-d81e-4244-9aa9-be39a55f12a6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.519163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f1e00-d81e-4244-9aa9-be39a55f12a6 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.520694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 933/1865] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:07:20.534093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.534397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.534690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.554872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:20.556312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:20.566047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 933/1866] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:07:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:20.586642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f1e00-d81e-4244-9aa9-be39a55f12a6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:20.603850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f1e00-d81e-4244-9aa9-be39a55f12a6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:20.605143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:20.618622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:20.619258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.619535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.619876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.630915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:20.632487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:20.646286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 934/1867] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:20.688179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb0623-ae73-48c9-99c8-0a3b7e6cab94 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:20.695000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:20.695867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:20.696216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:20.696548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] PATH_INFO: `/v3/users/4eac782a0f354f9188b859247a50b450` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:20.697884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eac782a0f354f9188b859247a50b450)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:20.704178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:20.720891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:20.761394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eac782a0f354f9188b859247a50b450'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:20.770735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eac782a0f354f9188b859247a50b450'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:20.781364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eac782a0f354f9188b859247a50b450'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:20.782101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eac782a0f354f9188b859247a50b450'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:20.809470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eac782a0f354f9188b859247a50b450'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:20.809470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 934/1868] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:20 2022] DELETE /identity/v3/users/4eac782a0f354f9188b859247a50b450 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:21.026955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:21.053255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db50b0-42da-40db-bb58-e9f63701b0ee service placement] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:21.068240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:21.158888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:21.159727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:21.160020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:21.160294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] PATH_INFO: `/v3/projects/6bbda3fd6cb74dcc9fbc8864405ebe96` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:21.161649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbda3fd6cb74dcc9fbc8864405ebe96)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:21.163604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:21.229024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbda3fd6cb74dcc9fbc8864405ebe96', 'request_id': 'req-fa169eb4-796c-48bf-915b-7432add4cfc2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.235166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbda3fd6cb74dcc9fbc8864405ebe96', 'request_id': 'req-fa169eb4-796c-48bf-915b-7432add4cfc2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.241376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbda3fd6cb74dcc9fbc8864405ebe96', 'request_id': 'req-fa169eb4-796c-48bf-915b-7432add4cfc2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.255952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] The token cache is being invalidate because project 6bbda3fd6cb74dcc9fbc8864405ebe96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:21.255952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.256604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.258411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 935/1869] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:21 2022] DELETE /identity/v3/projects/6bbda3fd6cb74dcc9fbc8864405ebe96 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:21.262233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:21.263660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:21.277960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df665-d428-4379-8ec2-05b49ca97a18 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:21.334313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:21.335006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:21.335279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:21.335546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] PATH_INFO: `/v3/users/f38d97e979e843dca6d231e2dcf7b1b0` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:21.336907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38d97e979e843dca6d231e2dcf7b1b0)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:21.338964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:21.386452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38d97e979e843dca6d231e2dcf7b1b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.393734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38d97e979e843dca6d231e2dcf7b1b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.402278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38d97e979e843dca6d231e2dcf7b1b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.402913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38d97e979e843dca6d231e2dcf7b1b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.415541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fe6acef3-b388-4c4f-8e50-d1f76521daa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38d97e979e843dca6d231e2dcf7b1b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.422167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 935/1870] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:21 2022] DELETE /identity/v3/users/f38d97e979e843dca6d231e2dcf7b1b0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:21.662162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:21.663664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:21.677090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa169eb4-796c-48bf-915b-7432add4cfc2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:21.755818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:21.756627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:21.756879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:21.757231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] PATH_INFO: `/v3/projects/273e7aa6df9e48f28dd9df535409ffea` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:21.758887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=273e7aa6df9e48f28dd9df535409ffea)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:21.760827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:21.815014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273e7aa6df9e48f28dd9df535409ffea', 'request_id': 'req-e0d35295-aed9-4016-b086-9b573f14d17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.816193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:21.823033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273e7aa6df9e48f28dd9df535409ffea', 'request_id': 'req-e0d35295-aed9-4016-b086-9b573f14d17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.830431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273e7aa6df9e48f28dd9df535409ffea', 'request_id': 'req-e0d35295-aed9-4016-b086-9b573f14d17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.843424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] The token cache is being invalidate because project 273e7aa6df9e48f28dd9df535409ffea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:21.843713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.844421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e0d35295-aed9-4016-b086-9b573f14d17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:21.846009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 936/1871] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:21 2022] DELETE /identity/v3/projects/273e7aa6df9e48f28dd9df535409ffea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:21.852090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:21.852578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:21.852678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:21.875112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:21.876375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:21.881254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:21.950160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 936/1872] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:21.958367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:21.958658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:21.958918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:21.979949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:21.981835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:21.990421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 937/1873] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:21.994787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.005539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3561f0-85ff-47ff-9537-8d47af1a233c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.010578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.011302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.011548 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.011820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.012640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:22.012870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.014482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.031333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 937/1874] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:22.032541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.041884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f97b3-7bf8-46e8-902f-15f478c14fc9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.046772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.047393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.047675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.047946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.048592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.050554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.096321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 938/1875] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:22 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:22.100256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.112542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73153-3ab7-49fa-b685-a6b59c1aa82b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.183448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.184791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.185288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.185751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.186572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.189284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.218123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 938/1876] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:22 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:22.222259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.241925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.244294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:22.254654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbc510-6855-4786-89bf-6cb3d8790da4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.260880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd89712-660d-4f87-9703-1d11e8cf9ced admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.266530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.266804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.267072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.267344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] PATH_INFO: `/v3/users/3ac4187a31954fa9892ecc747f68a1bc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.268870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.269902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac4187a31954fa9892ecc747f68a1bc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.271859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.274659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.274990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.275275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.276101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.277907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.294653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 939/1877] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:22.296332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.307944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89ed7-ebda-4cd4-8e3f-5f1fa035ec40 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.314526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.315180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.315536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.315739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.316456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.318220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.334364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 940/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:22.335360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.350232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3384-f8d6-41f8-9e15-22bfb15e41c7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.352015 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac4187a31954fa9892ecc747f68a1bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:22.362761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28788c72-9fa5-4cbc-a323-1fbc709152a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.363444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28788c72-9fa5-4cbc-a323-1fbc709152a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.363720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28788c72-9fa5-4cbc-a323-1fbc709152a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.363992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28788c72-9fa5-4cbc-a323-1fbc709152a9 admin admin] PATH_INFO: `/v3/projects/2e52e83d6bbc41118369ad5ebc3e522e/users/9d03b242c1cb4fd5b21f89e61abb96ac/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.366331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac4187a31954fa9892ecc747f68a1bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:22.381567 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac4187a31954fa9892ecc747f68a1bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:22.382285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac4187a31954fa9892ecc747f68a1bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:22.399221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28788c72-9fa5-4cbc-a323-1fbc709152a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e52e83d6bbc41118369ad5ebc3e522e, user_id=9d03b242c1cb4fd5b21f89e61abb96ac, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.402000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28788c72-9fa5-4cbc-a323-1fbc709152a9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.409604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f24dc7-8fc3-4411-bed9-183e90ff3b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac4187a31954fa9892ecc747f68a1bc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:22.411689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:22.420653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 939/1879] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:22 2022] DELETE /identity/v3/users/3ac4187a31954fa9892ecc747f68a1bc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:22.425927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.426541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.426897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.448687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 941/1880] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:22 2022] PUT /identity/v3/projects/2e52e83d6bbc41118369ad5ebc3e522e/users/9d03b242c1cb4fd5b21f89e61abb96ac/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:22.459276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.459916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.460501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.462446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:22.463830 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:22.507086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] MFA Rules not processed for user `9d03b242c1cb4fd5b21f89e61abb96ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:22.508859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:22.570520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 940/1881] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:22.577891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.581813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:22.636713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 942/1882] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:22.641242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.645912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:22.655924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb744-90e6-40cc-b69a-deb11f0fe540 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.660247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.661003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.661285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.661573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.669504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b98a92-1e8e-4074-8f05-839f280eecde None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.675414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.676089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.676688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.676962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.677617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.678066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.680538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.680970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.704582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 941/1883] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:22.729748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 943/1884] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:22 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:22.733656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.747814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665f528-391c-41ae-987b-ed516ce76190 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.827630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.828312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.828907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.829370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.830532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.832603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.865264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 942/1885] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:22 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:22.866373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.877988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de756a-0234-43a1-b91e-c0a98fa00c93 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.884640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.885252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.885854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.885854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.886486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.889668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.919102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 944/1886] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:22.920743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:22.936794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec10b6-d7d2-4e34-9b14-341ec3170cfe admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:22.944658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:22.945531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:22.945966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:22.946408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] PATH_INFO: `/v3/projects/8aa1cac49b244c31859641a55c174fff/users/04ab02bc947e487b89bcdd448094a737/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:22.965792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa1cac49b244c31859641a55c174fff, user_id=04ab02bc947e487b89bcdd448094a737, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:22.969649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:22.996248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 943/1887] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:22 2022] PUT /identity/v3/projects/8aa1cac49b244c31859641a55c174fff/users/04ab02bc947e487b89bcdd448094a737/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:22.997621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:23.015932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e606a1-32ba-4641-879b-6f0a63c1cf04 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:23.055443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:23.104175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc17e1-471e-4b97-9de3-1cad50b60af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:23.104969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17e1-471e-4b97-9de3-1cad50b60af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:23.105321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17e1-471e-4b97-9de3-1cad50b60af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:23.105847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17e1-471e-4b97-9de3-1cad50b60af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:23.106603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc17e1-471e-4b97-9de3-1cad50b60af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:23.109552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc17e1-471e-4b97-9de3-1cad50b60af8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:23.127751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 945/1888] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:23.128733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:23.142020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd44a51-c1be-486c-836c-efa9a55cc540 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:23.148088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:23.148917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:23.149201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:23.149558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] PATH_INFO: `/v3/projects/8aa1cac49b244c31859641a55c174fff/users/04ab02bc947e487b89bcdd448094a737/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:23.151566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa1cac49b244c31859641a55c174fff, user_id=04ab02bc947e487b89bcdd448094a737, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:23.155528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:23.159734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:23.170582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 944/1889] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:23 2022] PUT /identity/v3/projects/8aa1cac49b244c31859641a55c174fff/users/04ab02bc947e487b89bcdd448094a737/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:23.182402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:23.182687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:23.182970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:23.220221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] MFA Rules not processed for user `04ab02bc947e487b89bcdd448094a737`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:23.221928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:23.306236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 946/1890] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:23.320280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:23.322774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:23.401168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63189-632c-45ef-887b-36f04b6f3ee1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:23.405107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:23.408214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:23.408573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:23.408938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:23.424396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:23.426006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:23.439657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 945/1891] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:23.939600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:24.076706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849048-5a82-4321-b00a-5bfb5f5c2dc4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:24.111065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:24.111936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:24.112389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:24.112682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] PATH_INFO: `/v3/users/9d03b242c1cb4fd5b21f89e61abb96ac` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:24.114357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d03b242c1cb4fd5b21f89e61abb96ac)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:24.116392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:24.163324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:24.165871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.187752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c479df9-cdfe-4f31-9293-905386d24ffd service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:24.202694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:24.205883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:24.206350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:24.206707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] PATH_INFO: `/v3/projects/f3f5c389bc694a03a71ee0e197e297ca` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:24.209379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f5c389bc694a03a71ee0e197e297ca)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:24.216026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:24.288404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:24.290418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d03b242c1cb4fd5b21f89e61abb96ac'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.309264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d03b242c1cb4fd5b21f89e61abb96ac'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.310390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d03b242c1cb4fd5b21f89e61abb96ac'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.311650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d03b242c1cb4fd5b21f89e61abb96ac'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.328840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-759bec1e-9de8-43fb-9b7b-f2ff4d7887ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d03b242c1cb4fd5b21f89e61abb96ac'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.350588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 947/1892] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:23 2022] DELETE /identity/v3/users/9d03b242c1cb4fd5b21f89e61abb96ac => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:24.354959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:24.355458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:24.356041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:24.371131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f5c389bc694a03a71ee0e197e297ca', 'request_id': 'req-6ada1598-fd32-4973-8879-14cd561edf75'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.378146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f5c389bc694a03a71ee0e197e297ca', 'request_id': 'req-6ada1598-fd32-4973-8879-14cd561edf75'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.384645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:24.385967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.387699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f5c389bc694a03a71ee0e197e297ca', 'request_id': 'req-6ada1598-fd32-4973-8879-14cd561edf75'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.411479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] The token cache is being invalidate because project f3f5c389bc694a03a71ee0e197e297ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:24.411836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.412705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.414720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 946/1893] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:24 2022] DELETE /identity/v3/projects/f3f5c389bc694a03a71ee0e197e297ca => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:24.415963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:24.418188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.458867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 948/1894] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:24.459754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:24.461067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.473593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a9efe-3a1a-48a1-9d5b-0885b86ff50f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:24.478443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:24.479094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:24.479376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:24.479785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] PATH_INFO: `/v3/users/981f91ee6d4b491cbc2c0e6e3db61f31` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:24.481045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981f91ee6d4b491cbc2c0e6e3db61f31)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:24.482978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:24.497428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada1598-fd32-4973-8879-14cd561edf75 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:24.530598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:24.532605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981f91ee6d4b491cbc2c0e6e3db61f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.545890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981f91ee6d4b491cbc2c0e6e3db61f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.546590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981f91ee6d4b491cbc2c0e6e3db61f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.547217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981f91ee6d4b491cbc2c0e6e3db61f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.549760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:24.550377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:24.550652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:24.550920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:24.554660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.563784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981f91ee6d4b491cbc2c0e6e3db61f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:24.581535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 949/1895] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:24 2022] DELETE /identity/v3/users/981f91ee6d4b491cbc2c0e6e3db61f31 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:24.582156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:24.583718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.648520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:24.650057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:24.658221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:24.690172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 947/1896] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:24.703769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb588f-593d-44b2-a312-dfdb2a3d98b8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:24.710026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:24.710827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:24.711117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:24.711525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:24.713488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:24.807647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:24.811194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687d817-636e-4d5d-aa21-7db4e2105959 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:24.824668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 950/1897] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:25.081352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.082913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.099049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1c5b1-af7d-4982-9352-0c9a7b547617 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.108498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.109560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.110036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.110489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] PATH_INFO: `/v3/projects/9180408205664ec2a6accf1a17d355bf` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.113088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9180408205664ec2a6accf1a17d355bf)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.116486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.185521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9180408205664ec2a6accf1a17d355bf', 'request_id': 'req-99d2b86c-d698-45f0-b4dd-51765e1755db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.195001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9180408205664ec2a6accf1a17d355bf', 'request_id': 'req-99d2b86c-d698-45f0-b4dd-51765e1755db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.212142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9180408205664ec2a6accf1a17d355bf', 'request_id': 'req-99d2b86c-d698-45f0-b4dd-51765e1755db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.229726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] The token cache is being invalidate because project 9180408205664ec2a6accf1a17d355bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:25.230755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.231444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-99d2b86c-d698-45f0-b4dd-51765e1755db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.236701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 948/1898] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:25 2022] DELETE /identity/v3/projects/9180408205664ec2a6accf1a17d355bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:25.238051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.238511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.238600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.269082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:25.271782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.349166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 951/1899] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:25.352791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.353226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.353540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.393239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:25.396987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.422518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.424131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.433136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 949/1900] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:25.448075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.455673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232e6b6-9747-4172-bfe2-8fe9063a7e12 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.463904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a9490-2d01-42a2-9aa5-2d9524e637d4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.468863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.469730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.469962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.470238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.470894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:25.471597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.472338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.473202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.473627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.474040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] PATH_INFO: `/v3/projects/2e52e83d6bbc41118369ad5ebc3e522e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.475047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.475509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e52e83d6bbc41118369ad5ebc3e522e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.477857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.492978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 950/1901] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:07:25.496212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.515438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e25e27-ce00-4a9d-bef0-2eeadafa5930 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.521505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.522352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.522776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.523139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.524014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.526661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.573933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 951/1902] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:25 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:25.580295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.589149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e52e83d6bbc41118369ad5ebc3e522e', 'request_id': 'req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.601092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e52e83d6bbc41118369ad5ebc3e522e', 'request_id': 'req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.609946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e52e83d6bbc41118369ad5ebc3e522e', 'request_id': 'req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.626029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] The token cache is being invalidate because project 2e52e83d6bbc41118369ad5ebc3e522e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:25.626387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.627117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.628906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 952/1903] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:25 2022] DELETE /identity/v3/projects/2e52e83d6bbc41118369ad5ebc3e522e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:25.632115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:25.633022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.636410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.651304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:25.670668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a31b-b773-4676-be5e-f34e2e511e33 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.677468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.678512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.678986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.679432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.680415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.682777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.710990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 952/1904] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:25 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:25.714586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.716481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.728994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5b93c-39d4-42c7-be0a-059e0832cfbf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.730302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63db4-bd38-4420-9c10-0c9bd256d2b3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.733679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.734284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.734564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.734833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.735476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.735814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.736446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.736717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.737025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] PATH_INFO: `/v3/users/04ab02bc947e487b89bcdd448094a737` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.737129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.738347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ab02bc947e487b89bcdd448094a737)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.740243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.747067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 953/1905] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:25.751411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.762725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946daf-bc0a-4ad7-9e24-9017492cec35 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.767766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.768376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.768645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.768949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.769593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.771188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.781740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 954/1906] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:25.785826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.792045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ab02bc947e487b89bcdd448094a737'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.795541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e37f9-7d9e-4241-bda2-9a71ff94133f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:25.800132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:25.800772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.801079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.801355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] PATH_INFO: `/v3/projects/e9a82dcc45a44894885de29d8e539c43/users/84256244631c48efbe6552e7f1ef7a13/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.804350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ab02bc947e487b89bcdd448094a737'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.805138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ab02bc947e487b89bcdd448094a737'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.805750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ab02bc947e487b89bcdd448094a737'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.812518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f4a2576c-e760-4d0f-910f-b451df24cc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ab02bc947e487b89bcdd448094a737'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:25.816029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a82dcc45a44894885de29d8e539c43, user_id=84256244631c48efbe6552e7f1ef7a13, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:25.819055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:25.832692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 953/1907] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:25 2022] DELETE /identity/v3/users/04ab02bc947e487b89bcdd448094a737 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:25.835854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 955/1908] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:25 2022] PUT /identity/v3/projects/e9a82dcc45a44894885de29d8e539c43/users/84256244631c48efbe6552e7f1ef7a13/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:25.847439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:25.847718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:25.847987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:25.876305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] MFA Rules not processed for user `84256244631c48efbe6552e7f1ef7a13`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:25.877553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:25.962652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 954/1909] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:25.964426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:25.966244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.043629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c99ca-ddd1-4ac4-85b1-141217e0c256 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.113649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.114353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.114662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.114933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.115632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.119155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.151928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 956/1910] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:25 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:26.155670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.166609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643b060-6958-45fe-8116-9b68f6de8b7a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.179822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:26.237344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.238011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.238317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.238883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.239531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.242006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.253323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.255622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.272901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4346c-3f03-4c8f-a924-4b6ee94cef54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.274229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 955/1911] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:26 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:26.278674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.280203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.281361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.284449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.291643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea4bd-e05b-47c2-b49c-28ff7df2f32e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.295079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] PATH_INFO: `/v3/projects/8aa1cac49b244c31859641a55c174fff` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.297563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.298218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.298479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.298869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.299632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.300950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa1cac49b244c31859641a55c174fff)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.301146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.302903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.304653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:26.317646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 956/1912] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:26.322424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.334791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eca4a-34dc-402b-800d-f3929fcb994a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.342368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.343242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.343535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.343824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] PATH_INFO: `/v3/projects/ab7820aeca354a4a8bb3c3bb1c906003/users/d5551face10a4f469c3741934bc96253/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.362204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7820aeca354a4a8bb3c3bb1c906003, user_id=d5551face10a4f469c3741934bc96253, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.364794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.365671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa1cac49b244c31859641a55c174fff', 'request_id': 'req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:26.373522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa1cac49b244c31859641a55c174fff', 'request_id': 'req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:26.379517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 957/1913] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:26 2022] PUT /identity/v3/projects/ab7820aeca354a4a8bb3c3bb1c906003/users/d5551face10a4f469c3741934bc96253/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:26.383515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa1cac49b244c31859641a55c174fff', 'request_id': 'req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:26.383660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.396101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] The token cache is being invalidate because project 8aa1cac49b244c31859641a55c174fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:26.396385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:26.397067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-05c80b1b-fd52-483f-9aa4-aaa0d011dbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:26.398557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 957/1914] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:26 2022] DELETE /identity/v3/projects/8aa1cac49b244c31859641a55c174fff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:26.403664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b9fb6-e003-4fdf-94e5-8d639f1cfc93 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.403948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b9fb6-e003-4fdf-94e5-8d639f1cfc93 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.404227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b9fb6-e003-4fdf-94e5-8d639f1cfc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.428827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-533b9fb6-e003-4fdf-94e5-8d639f1cfc93 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:26.431167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-533b9fb6-e003-4fdf-94e5-8d639f1cfc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.459625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed41cb2-339d-451c-b286-659c0096bb41 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.467528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.468830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.469116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.469596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.471043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.472931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.490331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 958/1915] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:26.491497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.493588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.508621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb0575-36d7-4312-8e5f-7ca396d342a4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.512515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 958/1916] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:26.513759 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480140e8-fe8e-4c84-9e0b-0438c5ee85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.514457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480140e8-fe8e-4c84-9e0b-0438c5ee85d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.514768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480140e8-fe8e-4c84-9e0b-0438c5ee85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.515049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480140e8-fe8e-4c84-9e0b-0438c5ee85d6 admin admin] PATH_INFO: `/v3/projects/ab7820aeca354a4a8bb3c3bb1c906003/users/d5551face10a4f469c3741934bc96253/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.517522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480140e8-fe8e-4c84-9e0b-0438c5ee85d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7820aeca354a4a8bb3c3bb1c906003, user_id=d5551face10a4f469c3741934bc96253, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.519793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480140e8-fe8e-4c84-9e0b-0438c5ee85d6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.520326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.520683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.521053 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.531457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 959/1917] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:26 2022] PUT /identity/v3/projects/ab7820aeca354a4a8bb3c3bb1c906003/users/d5551face10a4f469c3741934bc96253/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:26.541594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.541951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.542273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.551073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:26.552271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.575388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] MFA Rules not processed for user `d5551face10a4f469c3741934bc96253`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:26.576703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.623107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:26.640943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 959/1918] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:26.642681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.658760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7eba8-5b8c-4fbd-846c-f38002eddc3f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.664919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 960/1919] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:26.670058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.670697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.670981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.671903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.677259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.678876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:26.680517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.686407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.688142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.726616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 960/1920] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:26.729021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.750109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31385e-8a38-4329-8b6d-0e2af28d0b6f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.757475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.758396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.758689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.758966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.759724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.761595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.797500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:26.830386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 961/1921] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:26 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:26.834424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.850513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352fd3-451f-4598-9a82-d4ca105abe32 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.928743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.929625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.930118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.930575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.932702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:26.933056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fe8e9-8ed3-4b9f-b572-c7a9262d7d71 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.939122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:26.940165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:26.940545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:26.941009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:26.942164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:26.944710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:26.976911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 962/1922] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:26 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:26.979662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:26.992743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3559c-0391-41a2-9d24-3f88d9e7b2f8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:26.999648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:27.000527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.000929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.001392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.002144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.004109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.017953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 963/1923] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:27.021813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:27.027121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.027842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.036286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27ff8e-593a-4c02-9099-d7f48f8d3e54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:27.041399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c96ab-c6dd-424e-9c91-3465c093b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:27.042001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c96ab-c6dd-424e-9c91-3465c093b7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.042281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c96ab-c6dd-424e-9c91-3465c093b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.042650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 961/1924] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:27.043637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c96ab-c6dd-424e-9c91-3465c093b7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.044307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c96ab-c6dd-424e-9c91-3465c093b7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.046111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c96ab-c6dd-424e-9c91-3465c093b7dc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.060845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 964/1925] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:27.065462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:27.076276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b017f5-865e-4349-9e86-e22fa86c1a47 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:27.080937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:27.081671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.082029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.082307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] PATH_INFO: `/v3/projects/018bc3de9eca4ccab0da488dacf32f3a/users/18a47580984245ac81f533b36409ebec/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.117030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018bc3de9eca4ccab0da488dacf32f3a, user_id=18a47580984245ac81f533b36409ebec, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.121032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.141632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 962/1926] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:27 2022] PUT /identity/v3/projects/018bc3de9eca4ccab0da488dacf32f3a/users/18a47580984245ac81f533b36409ebec/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:27.147267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.148078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.148551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.180364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:27.182040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:27.268985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:27.270881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:27.298522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 965/1927] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:27.308330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:27.310432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:27.333537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:27.379581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b603e-3c92-4c43-a0e1-2b2485e45b22 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:27.383448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f009ea-2a10-47e2-be43-f2ef70971c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:27.384311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f009ea-2a10-47e2-be43-f2ef70971c70 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.384423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a1db-5461-445c-bf7b-f2621779a545 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:27.384505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f009ea-2a10-47e2-be43-f2ef70971c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.384968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f009ea-2a10-47e2-be43-f2ef70971c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.389355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:27.389986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.390467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.390660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] PATH_INFO: `/v3/users/97aec507d2f84924b86e19a30a172525` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.391919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97aec507d2f84924b86e19a30a172525)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.393863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.395722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f009ea-2a10-47e2-be43-f2ef70971c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.397296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f009ea-2a10-47e2-be43-f2ef70971c70 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.408166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 966/1928] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:27.449168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97aec507d2f84924b86e19a30a172525'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:27.475769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97aec507d2f84924b86e19a30a172525'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:27.476623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97aec507d2f84924b86e19a30a172525'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:27.477541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97aec507d2f84924b86e19a30a172525'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:27.486119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97aec507d2f84924b86e19a30a172525'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:27.512494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 963/1929] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:27 2022] DELETE /identity/v3/users/97aec507d2f84924b86e19a30a172525 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:27.518528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.518829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.519346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.557067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:27.572479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:27.574324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:27.682281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 967/1930] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:27.720880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:27.722617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:27.805293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5086020-ea2e-4a66-b791-1978ad7a1d78 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:27.809579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1406c-0e70-448a-90ac-adf0b4f61699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:27.810529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1406c-0e70-448a-90ac-adf0b4f61699 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:27.810875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1406c-0e70-448a-90ac-adf0b4f61699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:27.811223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1406c-0e70-448a-90ac-adf0b4f61699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:27.825916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1406c-0e70-448a-90ac-adf0b4f61699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:27.827507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1406c-0e70-448a-90ac-adf0b4f61699 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:27.842601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 964/1931] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:28.194404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:28.196262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:28.209216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7fb6-1971-4bd4-81ac-6f15cbe88776 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:28.219290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:28.219963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.220257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.220532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] PATH_INFO: `/v3/projects/bcf963d1108e44ef9c189af5bc6f4cf9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.222209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf963d1108e44ef9c189af5bc6f4cf9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:28.224159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:28.298620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf963d1108e44ef9c189af5bc6f4cf9', 'request_id': 'req-c9462cec-2080-40a9-9394-925f8c5fc609'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.316450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf963d1108e44ef9c189af5bc6f4cf9', 'request_id': 'req-c9462cec-2080-40a9-9394-925f8c5fc609'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.329198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf963d1108e44ef9c189af5bc6f4cf9', 'request_id': 'req-c9462cec-2080-40a9-9394-925f8c5fc609'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.354307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] The token cache is being invalidate because project bcf963d1108e44ef9c189af5bc6f4cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:28.355010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.355892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.358081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 968/1932] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:28 2022] DELETE /identity/v3/projects/bcf963d1108e44ef9c189af5bc6f4cf9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:28.361108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.361944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.362222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:28.362682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.365717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:28.418175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] MFA Rules not processed for user `18a47580984245ac81f533b36409ebec`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:28.421576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:28.452617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9462cec-2080-40a9-9394-925f8c5fc609 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:28.457626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:28.458266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.458541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.458810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] PATH_INFO: `/v3/users/8080c3a6ab4440f4b1abff11e721a364` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.460060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8080c3a6ab4440f4b1abff11e721a364)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:28.462098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:28.498452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:28.504928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:28.525779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8080c3a6ab4440f4b1abff11e721a364'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.535875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8080c3a6ab4440f4b1abff11e721a364'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.543368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 965/1933] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:28.548076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:28.549466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:28.550147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8080c3a6ab4440f4b1abff11e721a364'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.550921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8080c3a6ab4440f4b1abff11e721a364'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.563067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b654-8056-4e7b-89d2-e4758f833a1d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:28.565778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8080c3a6ab4440f4b1abff11e721a364'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:28.569099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:28.569748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.570031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.570374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.571008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:28.573127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:28.574740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 969/1934] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:28 2022] DELETE /identity/v3/users/8080c3a6ab4440f4b1abff11e721a364 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:28.612345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 966/1935] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:28 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:28.616696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:28.618363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:28.718362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474aeff-5354-4b9a-90c3-7b0b10c8b2a0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:28.822462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:28.823147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.825020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.825467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.826239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:28.828407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:28.859657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 970/1936] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:28 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:28.864126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:28.876958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ab9d4-589e-458b-a6f0-265e770d6c74 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:28.883983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:28.884654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.884991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.885262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.885970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:28.888243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:28.906368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 967/1937] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:28.910344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:28.924348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab238-450c-4ccb-b53b-5856b11e7c8d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:28.930876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:28.931676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:28.932374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:28.932752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] PATH_INFO: `/v3/projects/2d2c5a7eded14a06b39988997a53e826/users/5269ae85f9b34930b06a47e095d62d34/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:28.973120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2c5a7eded14a06b39988997a53e826, user_id=5269ae85f9b34930b06a47e095d62d34, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:28.976612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:28.994007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 971/1938] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:28 2022] PUT /identity/v3/projects/2d2c5a7eded14a06b39988997a53e826/users/5269ae85f9b34930b06a47e095d62d34/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:28.997862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:29.011573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef8c29-73a4-42c7-be5d-d3b8953a14ce admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:29.115340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:29.115909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:29.116186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:29.116754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:29.117628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:29.119372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:29.124230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:29.126307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:29.134073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 968/1939] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:29.141051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:29.151780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b3622-184c-4ff2-ac82-54c0d8e36e8e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:29.157455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:29.158873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:29.159699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:29.159699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] PATH_INFO: `/v3/projects/2d2c5a7eded14a06b39988997a53e826/users/5269ae85f9b34930b06a47e095d62d34/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:29.162189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2c5a7eded14a06b39988997a53e826, user_id=5269ae85f9b34930b06a47e095d62d34, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:29.165444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee46cb-9519-4a08-bef2-ae69e753cc06 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:29.165601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:29.183927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 969/1940] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:29 2022] PUT /identity/v3/projects/2d2c5a7eded14a06b39988997a53e826/users/5269ae85f9b34930b06a47e095d62d34/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:29.187431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:29.187431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:29.187431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:29.187431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] PATH_INFO: `/v3/projects/b238de8ff65440b4884efee422aee4a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:29.199229 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b238de8ff65440b4884efee422aee4a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:29.201482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:29.224003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:29.271200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b238de8ff65440b4884efee422aee4a5', 'request_id': 'req-e3e48bf6-866f-4589-ab74-908171a398b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.279652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b238de8ff65440b4884efee422aee4a5', 'request_id': 'req-e3e48bf6-866f-4589-ab74-908171a398b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.292516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b238de8ff65440b4884efee422aee4a5', 'request_id': 'req-e3e48bf6-866f-4589-ab74-908171a398b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.318985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] The token cache is being invalidate because project b238de8ff65440b4884efee422aee4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:29.318985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.318985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.318985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 972/1941] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:29 2022] DELETE /identity/v3/projects/b238de8ff65440b4884efee422aee4a5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:29.322074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:29.325671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:29.414481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163afed-c981-41ce-bdfe-bfeeb84cf3f6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:29.454011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:29.483827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:29.484474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:29.484756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:29.485060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] PATH_INFO: `/v3/users/455c51b073a342b89ca3ba1eb7b31360` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:29.486353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455c51b073a342b89ca3ba1eb7b31360)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:29.488292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:29.544365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455c51b073a342b89ca3ba1eb7b31360'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.558207 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455c51b073a342b89ca3ba1eb7b31360'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.559409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455c51b073a342b89ca3ba1eb7b31360'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.560103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455c51b073a342b89ca3ba1eb7b31360'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.568121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-53a8daa3-8784-43ac-845c-724319cb0194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455c51b073a342b89ca3ba1eb7b31360'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:29.595693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 970/1942] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:29 2022] DELETE /identity/v3/users/455c51b073a342b89ca3ba1eb7b31360 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:29.950562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:29.962169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48bf6-866f-4589-ab74-908171a398b6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.032976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c23b-1971-41b4-9aeb-e5332b6ae064 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.033269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c23b-1971-41b4-9aeb-e5332b6ae064 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.033543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c23b-1971-41b4-9aeb-e5332b6ae064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.057381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.058133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.058482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.058838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] PATH_INFO: `/v3/projects/9f796f94cbea489baaa7e45ccfa9d8f2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.060196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f796f94cbea489baaa7e45ccfa9d8f2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:30.063364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:30.066643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-95c9c23b-1971-41b4-9aeb-e5332b6ae064 None None] MFA Rules not processed for user `5269ae85f9b34930b06a47e095d62d34`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:30.068374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-95c9c23b-1971-41b4-9aeb-e5332b6ae064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:30.133671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f796f94cbea489baaa7e45ccfa9d8f2', 'request_id': 'req-f04d63fa-d97f-40c3-aae8-7ea089401fe7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:30.141106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f796f94cbea489baaa7e45ccfa9d8f2', 'request_id': 'req-f04d63fa-d97f-40c3-aae8-7ea089401fe7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:30.151473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f796f94cbea489baaa7e45ccfa9d8f2', 'request_id': 'req-f04d63fa-d97f-40c3-aae8-7ea089401fe7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:30.165495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] The token cache is being invalidate because project 9f796f94cbea489baaa7e45ccfa9d8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:30.165782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:30.166434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f04d63fa-d97f-40c3-aae8-7ea089401fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:30.172645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 973/1943] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:29 2022] DELETE /identity/v3/projects/9f796f94cbea489baaa7e45ccfa9d8f2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:30.174688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc6d0-5928-4dac-bae0-1ce9c979899b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.174997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc6d0-5928-4dac-bae0-1ce9c979899b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.175244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc6d0-5928-4dac-bae0-1ce9c979899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.197350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-30fbc6d0-5928-4dac-bae0-1ce9c979899b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:30.198566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 971/1944] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:30.203868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30fbc6d0-5928-4dac-bae0-1ce9c979899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:30.213930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.214394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.214836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.257786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] MFA Rules not processed for user `18a47580984245ac81f533b36409ebec`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:30.262083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:30.263799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:30.329841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:30.349493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 974/1945] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:30.358130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.358305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.358525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.382421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:30.383770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:30.387964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 972/1946] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:30.397063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 975/1947] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:30.403295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:30.428365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc7a48-d15f-474d-8155-12365daa0fd3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.434458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:30.435965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:30.446285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.446927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.447204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.449422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.450110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:30.450450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:30.454392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:30.483429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 973/1948] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:30.487722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:30.506743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acc9cb-0df8-4564-84d5-a4f72f543eba admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.517440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.517971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.518255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.518516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.519230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:30.521201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:30.583368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d462d2-8f2a-4f5c-8ac9-8ff341c61303 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.588754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 974/1949] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:30 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:30.590313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:30.733051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dfee3-1d98-4444-9fc7-15da547f66ba admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.764208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.764895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.765181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.765457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.768444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:30.777268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:30.810224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.814482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.815038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.816161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.820101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:30.824788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 975/1950] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:30 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:30.826519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:30.846371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd29e08-1065-4488-9cb5-138643f2073e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.870137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.871286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.871487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.873616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.876340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:30.880996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:30.920752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 976/1951] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:30.922059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:30.948825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b387d-27c7-4d49-ad12-5c0e5575b492 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:30.964776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:30.965456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:30.965738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:30.966009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:30.966664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:30.973257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:30.987771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 977/1952] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:30.996419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:31.007699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:31.010165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5a03b-3476-4285-966c-dfa1cc3d8491 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:31.028359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a46a-73e2-4406-a674-84efdc5838cf admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:31.030847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 976/1953] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:07:31.034032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:31.034705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:31.034984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:31.035255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] PATH_INFO: `/v3/projects/a8a40a3a564a41dbb1d76b2cd0d7c30b/users/a2ca5821f7a94724ac8ef87ad48aa446/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:31.068593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a40a3a564a41dbb1d76b2cd0d7c30b, user_id=a2ca5821f7a94724ac8ef87ad48aa446, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:31.071540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:31.099433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 978/1954] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:30 2022] PUT /identity/v3/projects/a8a40a3a564a41dbb1d76b2cd0d7c30b/users/a2ca5821f7a94724ac8ef87ad48aa446/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:31.103191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:31.104310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:31.104657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:31.121221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:31.155771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] MFA Rules not processed for user `a2ca5821f7a94724ac8ef87ad48aa446`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:31.157311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:31.235407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 977/1955] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:31.247365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:31.249702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:31.315509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ba7ea-c461-4931-92d3-b09bbe1b8222 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:31.319294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c615d-96d0-43b2-8421-afefde10782d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:31.319901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c615d-96d0-43b2-8421-afefde10782d service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:31.320177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c615d-96d0-43b2-8421-afefde10782d service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:31.320491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c615d-96d0-43b2-8421-afefde10782d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:31.328880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:31.331444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c615d-96d0-43b2-8421-afefde10782d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:31.333024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c615d-96d0-43b2-8421-afefde10782d service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:31.343683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 979/1956] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:31.368057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:31.463963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1322a-9bf7-41f8-9389-0247859ce646 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:31.469692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:31.470635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:31.470949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:31.473320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] PATH_INFO: `/v3/users/a2ca5821f7a94724ac8ef87ad48aa446` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:31.474823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ca5821f7a94724ac8ef87ad48aa446)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:31.477219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:31.538757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ca5821f7a94724ac8ef87ad48aa446'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:31.550979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ca5821f7a94724ac8ef87ad48aa446'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:31.561603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ca5821f7a94724ac8ef87ad48aa446'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:31.562942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ca5821f7a94724ac8ef87ad48aa446'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:31.584297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ca5821f7a94724ac8ef87ad48aa446'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:31.591894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 978/1957] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:31 2022] DELETE /identity/v3/users/a2ca5821f7a94724ac8ef87ad48aa446 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:31.596321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:31.596857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:31.596857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:31.618760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:31.620816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:31.725125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 980/1958] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:31.735480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:31.736737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:31.752339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:31.852498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf0f6e-5f21-4cff-aee3-ad10e5d01473 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:31.865507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:31.877034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:31.885981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:31.887172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:31.921772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:31.923403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:31.961836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 979/1959] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:32.077167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:32.079707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:32.235379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452a0b7-eb06-45ad-923c-38b035e6eba2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:32.242970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:32.246735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:32.247593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:32.249219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:32.268116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:32.406174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:32.408268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390881-1974-47a5-ad09-b5fa5fee4338 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:32.419767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 981/1960] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:32.499718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:32.501375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:32.523110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1533c-3bd9-4e03-91ba-daa406274232 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:32.528260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:32.529993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:32.530456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:32.530898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] PATH_INFO: `/v3/projects/a8a40a3a564a41dbb1d76b2cd0d7c30b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:32.532262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a40a3a564a41dbb1d76b2cd0d7c30b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:32.534478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:32.602302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a40a3a564a41dbb1d76b2cd0d7c30b', 'request_id': 'req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:32.607897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a40a3a564a41dbb1d76b2cd0d7c30b', 'request_id': 'req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:32.617122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a40a3a564a41dbb1d76b2cd0d7c30b', 'request_id': 'req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:32.631450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] The token cache is being invalidate because project a8a40a3a564a41dbb1d76b2cd0d7c30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:32.631744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:32.632434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d7f26860-62d9-4865-9ce2-4f7a3b085e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:32.634034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 980/1961] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:32 2022] DELETE /identity/v3/projects/a8a40a3a564a41dbb1d76b2cd0d7c30b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:32.640308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:32.640835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:32.641230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:32.667751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:32.669170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:32.730485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:32.790656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 982/1962] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:32.799443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:32.800071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:32.802549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:32.864339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:32.868604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:32.891565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 981/1963] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:32.897922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:32.912334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29db6-22de-4dab-908a-9448b3b4c3be None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:32.930882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:32.931660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:32.931944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:32.932213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:32.936720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:32.938106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:32.944785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:32.976981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 983/1964] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:32.981474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:32.994525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84f67-b33b-47f5-9693-d8a5007ec54e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:33.001009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:33.001671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.002045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.002404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.003584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:33.005613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:33.056011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 982/1965] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:32 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:33.059780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:33.070751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665c06-9e39-4581-993d-0114bccb3968 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:33.135826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:33.136453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.136741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.137065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.137674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:33.139770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:33.166667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 984/1966] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:33 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:33.169065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:33.179391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd889b01-1ca1-4ab5-86f4-130de9a3e036 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:33.184903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:33.185530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.185808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.186081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.186737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:33.188368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:33.198938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 983/1967] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:33.203768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:33.215957 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0ff2c-73e7-415f-887c-ff5cb6691ddc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:33.221057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734632af-afa6-487c-bad9-29c6a49dade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:33.221683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734632af-afa6-487c-bad9-29c6a49dade5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.221964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734632af-afa6-487c-bad9-29c6a49dade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.222240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734632af-afa6-487c-bad9-29c6a49dade5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.222892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734632af-afa6-487c-bad9-29c6a49dade5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:33.224524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734632af-afa6-487c-bad9-29c6a49dade5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:33.236502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 985/1968] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:33.240957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:33.251588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57a510-4d50-4984-9993-f9ca0bb0f51d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:33.257795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:33.258500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.258800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.259072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] PATH_INFO: `/v3/projects/ac7cd908b92a40d98a72446aa9775c68/users/2681f2ebaec541609438732f4ed49113/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.274171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7cd908b92a40d98a72446aa9775c68, user_id=2681f2ebaec541609438732f4ed49113, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:33.276859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:33.292446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 984/1969] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:33 2022] PUT /identity/v3/projects/ac7cd908b92a40d98a72446aa9775c68/users/2681f2ebaec541609438732f4ed49113/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:33.303576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.304077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.304480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.336258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] MFA Rules not processed for user `2681f2ebaec541609438732f4ed49113`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:33.337461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:33.408571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 986/1970] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:33.430813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:33.432763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:33.479800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:33.527772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c254a8-f3a0-4beb-a583-d6e1dc8a18de admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:33.533400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128a25f-448a-4801-98a4-1a4bac0985fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:33.534272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128a25f-448a-4801-98a4-1a4bac0985fe service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:33.534841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128a25f-448a-4801-98a4-1a4bac0985fe service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:33.535261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128a25f-448a-4801-98a4-1a4bac0985fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:33.545111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128a25f-448a-4801-98a4-1a4bac0985fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:33.547141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128a25f-448a-4801-98a4-1a4bac0985fe service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:33.558932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 985/1971] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:37.834286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:37.835835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:37.893942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:37.930786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1923-ca7d-497c-b30f-3ea0e98abf48 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:37.937705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:37.939153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:37.939498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:37.939847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] PATH_INFO: `/v3/users/84256244631c48efbe6552e7f1ef7a13` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:37.941230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84256244631c48efbe6552e7f1ef7a13)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:37.943643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:38.032040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84256244631c48efbe6552e7f1ef7a13'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:38.046723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84256244631c48efbe6552e7f1ef7a13'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:38.047642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84256244631c48efbe6552e7f1ef7a13'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:38.048322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84256244631c48efbe6552e7f1ef7a13'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:38.058022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84256244631c48efbe6552e7f1ef7a13'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:38.071866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 987/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:37 2022] DELETE /identity/v3/users/84256244631c48efbe6552e7f1ef7a13 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:38.076518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:38.077103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:38.077219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:38.096921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:38.098659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:38.176467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 986/1973] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:38.198260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:38.200421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:38.301260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7913-16fd-4175-b887-4d487bda4d0b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:38.305061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:38.305791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:38.306190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:38.306557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:38.316639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:38.318264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:38.329841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 988/1974] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:39.223216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:39.224872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:39.251562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a37962-f6d5-4db8-a0f2-57d4264986cc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:39.274230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:39.274892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:39.275165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:39.275440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] PATH_INFO: `/v3/projects/e9a82dcc45a44894885de29d8e539c43` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:39.282107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a82dcc45a44894885de29d8e539c43)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:39.284062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:39.360765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a82dcc45a44894885de29d8e539c43', 'request_id': 'req-077b00e3-03b4-46e3-98a4-9c5cc7724733'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.367611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a82dcc45a44894885de29d8e539c43', 'request_id': 'req-077b00e3-03b4-46e3-98a4-9c5cc7724733'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.377656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a82dcc45a44894885de29d8e539c43', 'request_id': 'req-077b00e3-03b4-46e3-98a4-9c5cc7724733'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.404217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] The token cache is being invalidate because project e9a82dcc45a44894885de29d8e539c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:39.405013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.405420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.416848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 987/1975] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:39 2022] DELETE /identity/v3/projects/e9a82dcc45a44894885de29d8e539c43 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:39.423194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:39.456127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0202-78cc-4ca8-9c71-ddc8339a6e3d service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:39.540702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:39.545087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:39.545771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:39.546189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] PATH_INFO: `/v3/users/d5551face10a4f469c3741934bc96253` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:39.549869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5551face10a4f469c3741934bc96253)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:39.552693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:39.558121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:39.686683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5551face10a4f469c3741934bc96253'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.724085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5551face10a4f469c3741934bc96253'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.728092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5551face10a4f469c3741934bc96253'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.728896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5551face10a4f469c3741934bc96253'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.766670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0fa474fe-2ab8-4dc5-aba3-2d1bc3c08ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5551face10a4f469c3741934bc96253'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:39.792553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 989/1976] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:39 2022] DELETE /identity/v3/users/d5551face10a4f469c3741934bc96253 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:40.369095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:40.374409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:40.389575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b00e3-03b4-46e3-98a4-9c5cc7724733 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:40.460941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:40.495819 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:40.496500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:40.496780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:40.497095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] PATH_INFO: `/v3/projects/ab7820aeca354a4a8bb3c3bb1c906003` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:40.499977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7820aeca354a4a8bb3c3bb1c906003)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:40.503174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:40.566805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7820aeca354a4a8bb3c3bb1c906003', 'request_id': 'req-e70087ce-f053-4ca4-8d6a-743a63d20151'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:40.580070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7820aeca354a4a8bb3c3bb1c906003', 'request_id': 'req-e70087ce-f053-4ca4-8d6a-743a63d20151'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:40.589659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7820aeca354a4a8bb3c3bb1c906003', 'request_id': 'req-e70087ce-f053-4ca4-8d6a-743a63d20151'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:40.609996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] The token cache is being invalidate because project ab7820aeca354a4a8bb3c3bb1c906003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:40.610279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:40.610951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e70087ce-f053-4ca4-8d6a-743a63d20151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:40.617469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 988/1977] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:40 2022] DELETE /identity/v3/projects/ab7820aeca354a4a8bb3c3bb1c906003 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:40.619745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:40.619745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:40.620320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:40.646357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:40.647702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:40.744887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 990/1978] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:40.748354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:40.749077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:40.749485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:40.771847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:40.773171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:40.783530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 989/1979] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:40.795087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:40.807150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb418-ce35-4eed-a91a-86dc9ba06cd8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:40.812199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:40.812925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:40.813274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:40.813613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:40.814350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:40.814886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:40.816607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:40.841675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 991/1980] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:40.844135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:40.854126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbfbf-add1-46bf-a801-d424c6ebdfaa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:40.858973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:40.859584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:40.859860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:40.860128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:40.860787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:40.862709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:40.893202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 990/1981] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:40.897518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:40.907982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a0c1b-63b2-4d0c-ba20-1326b16619d9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:40.970250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:40.971022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:40.971310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:40.971582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:40.972231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:40.974318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:40.998994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:41.006817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 992/1982] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:40 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:41.010972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:41.021741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b975b75-124a-499c-8ddf-08a9ddba4a7b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:41.026621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:41.028840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:41.028840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:41.028840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:41.028840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:41.032329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:41.048563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 991/1983] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:41.050012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:41.061874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2a60a-1c9f-461f-8cc3-64d143127fd1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:41.067211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc18a3-3784-45fb-9fdf-5119c19ec2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:41.067815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc18a3-3784-45fb-9fdf-5119c19ec2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:41.068097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc18a3-3784-45fb-9fdf-5119c19ec2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:41.068370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc18a3-3784-45fb-9fdf-5119c19ec2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:41.069072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc18a3-3784-45fb-9fdf-5119c19ec2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:41.070993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc18a3-3784-45fb-9fdf-5119c19ec2e6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:41.083540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 993/1984] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:41.088289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:41.099307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299766a-652f-44e5-ad07-fd21183cfa50 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:41.104324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:41.105142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:41.105426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:41.105703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] PATH_INFO: `/v3/projects/32d5e08ecb684a20b040a98b846b4da2/users/729a04ec23884882a18392fcf1462b18/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:41.126279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d5e08ecb684a20b040a98b846b4da2, user_id=729a04ec23884882a18392fcf1462b18, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:41.129282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:41.158295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 992/1985] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:41 2022] PUT /identity/v3/projects/32d5e08ecb684a20b040a98b846b4da2/users/729a04ec23884882a18392fcf1462b18/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:41.159137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:41.159472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:41.159750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:41.196955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] MFA Rules not processed for user `729a04ec23884882a18392fcf1462b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:41.198700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:41.288198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 994/1986] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:41.301313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:41.303078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:41.382502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db77ab-7a9a-4c60-9340-202167aaf56c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:41.387585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad90a14-a67d-4726-9ac9-ec0053e1855c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:41.388272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90a14-a67d-4726-9ac9-ec0053e1855c service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:41.388645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90a14-a67d-4726-9ac9-ec0053e1855c service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:41.388958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad90a14-a67d-4726-9ac9-ec0053e1855c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:41.401530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90a14-a67d-4726-9ac9-ec0053e1855c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:41.403023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad90a14-a67d-4726-9ac9-ec0053e1855c service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:41.417228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 993/1987] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:51.283970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=38 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:51.412849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:57.532103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:57.641007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66678d-f4bf-4f0a-8023-d6cb24227882 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:57.654007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:57.654754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:57.655080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:57.655406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] PATH_INFO: `/v3/users/729a04ec23884882a18392fcf1462b18` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:57.657872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=729a04ec23884882a18392fcf1462b18)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:57.659978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:57.732628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729a04ec23884882a18392fcf1462b18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:57.747776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729a04ec23884882a18392fcf1462b18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:57.748910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729a04ec23884882a18392fcf1462b18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:57.749551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729a04ec23884882a18392fcf1462b18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:57.758649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729a04ec23884882a18392fcf1462b18'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:57.777038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 995/1988] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:57 2022] DELETE /identity/v3/users/729a04ec23884882a18392fcf1462b18 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:57.781522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:57.782084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:57.782084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:57.802904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:57.804431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:57.883421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 994/1989] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:57.893363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:57.895162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:57.977424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3aec-982d-4cf3-a955-c9db25cba59f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:57.987493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:57.987493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:57.987493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:57.987493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:57.993647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:57.995219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.005858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 996/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:07:58.221795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.223475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.236758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f980e6-2ea8-45c3-836b-3457f6d5d60c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.241738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.242539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.243102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.243561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] PATH_INFO: `/v3/users/62400b08a4a64692a2dc43026f4a7986` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.245040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62400b08a4a64692a2dc43026f4a7986)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.247418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.295258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.297148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.309859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62400b08a4a64692a2dc43026f4a7986'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.319891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62400b08a4a64692a2dc43026f4a7986'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.329008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c004c-8f07-4e9b-9358-24eb0a71489d service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.334694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62400b08a4a64692a2dc43026f4a7986'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.335853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62400b08a4a64692a2dc43026f4a7986'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.337331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.338005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.338278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.338549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] PATH_INFO: `/v3/projects/32d5e08ecb684a20b040a98b846b4da2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.340424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d5e08ecb684a20b040a98b846b4da2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.342291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.350012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93845ae2-3140-4d82-90cb-d4a4f8ceedfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62400b08a4a64692a2dc43026f4a7986'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.358010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 995/1991] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:07:58 2022] DELETE /identity/v3/users/62400b08a4a64692a2dc43026f4a7986 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:58.361733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:58.414592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d5e08ecb684a20b040a98b846b4da2', 'request_id': 'req-420e848e-5a76-4113-a824-289c41ca3656'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.422825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d5e08ecb684a20b040a98b846b4da2', 'request_id': 'req-420e848e-5a76-4113-a824-289c41ca3656'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.429021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d5e08ecb684a20b040a98b846b4da2', 'request_id': 'req-420e848e-5a76-4113-a824-289c41ca3656'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.443509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] The token cache is being invalidate because project 32d5e08ecb684a20b040a98b846b4da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:58.443812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.444442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-420e848e-5a76-4113-a824-289c41ca3656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.446287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 997/1992] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:58 2022] DELETE /identity/v3/projects/32d5e08ecb684a20b040a98b846b4da2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:58.451353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.451710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.451990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.473386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:58.474597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.537640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 996/1993] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:58.546091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.546960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.547445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.569994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:58.571307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.581029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 998/1994] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:58.592046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.595266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02926e-60ee-4d90-bfa1-1b2ce6bab480 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.613899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.614701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.614835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.615487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.616041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:58.616324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.618216 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.628274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:58.632279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 997/1995] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:07:58.636660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.649265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.651284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.652454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62688ae-e90f-412e-bdd3-b29b6c53c92a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.663210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.663954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.664646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.664961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.665630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.667100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504abb72-94ae-48a8-9a98-980230153d6b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.667691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.672128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.672776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.673093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.673374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] PATH_INFO: `/v3/projects/55b66adef4f04038a5b54f5dffc93011` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.674524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b66adef4f04038a5b54f5dffc93011)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.676677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.715743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 999/1996] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:58.716624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.759405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b66adef4f04038a5b54f5dffc93011', 'request_id': 'req-8d6c39fd-26fd-490b-a980-32be52705752'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.767042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b66adef4f04038a5b54f5dffc93011', 'request_id': 'req-8d6c39fd-26fd-490b-a980-32be52705752'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.777346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b66adef4f04038a5b54f5dffc93011', 'request_id': 'req-8d6c39fd-26fd-490b-a980-32be52705752'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.781547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633084-af5c-4a41-ba04-48c1a872bc7a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.790832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] The token cache is being invalidate because project 55b66adef4f04038a5b54f5dffc93011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:07:58.791339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.791761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8d6c39fd-26fd-490b-a980-32be52705752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:07:58.793315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 998/1997] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:07:58 2022] DELETE /identity/v3/projects/55b66adef4f04038a5b54f5dffc93011 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:58.798162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660122-1304-4564-8f10-0ab29b3ebb65 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.798448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660122-1304-4564-8f10-0ab29b3ebb65 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.798721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660122-1304-4564-8f10-0ab29b3ebb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.821549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-eb660122-1304-4564-8f10-0ab29b3ebb65 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:58.822778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eb660122-1304-4564-8f10-0ab29b3ebb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.848896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.849530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.849783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.850116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.850907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.853068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.879276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1000/1998] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:58.883824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.885809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.891499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 999/1999] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:58.899359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.899640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.899917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.901497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25825d-c91f-42ef-9d77-177a50a94dd1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.907647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.908269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.908546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.908901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.909610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.912000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.921809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:58.923485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:58.923728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1001/2000] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:58.927582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.933064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:58.940161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a900-326d-42e3-a029-5e2d13417dd4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.943480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1000/2001] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:58.947993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.950703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.951354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.951640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.951916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.952915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.955507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.958523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd437b-f3a9-4fde-bb87-1308f8ca24f3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.963932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.964622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.964998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.965582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.966185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:07:58.966563 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:58.971138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:58.971341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1002/2002] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:58.972115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:58.983987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05643330-5cff-4af7-8658-990d613f5ca5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:58.992620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1001/2003] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:07:58.993092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2530c-dc23-44bd-97f9-26a956dd7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:58.993092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2530c-dc23-44bd-97f9-26a956dd7597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:58.993092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2530c-dc23-44bd-97f9-26a956dd7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:58.993092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2530c-dc23-44bd-97f9-26a956dd7597 admin admin] PATH_INFO: `/v3/projects/59411413f40e41b3947be0864ca01a23/users/4b27955bfdf54f4a90b71accc81fce10/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:58.994891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.006446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca93a9-a35e-42bd-8810-34501b803cc7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.011473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.012315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.012664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.013027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.013201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2530c-dc23-44bd-97f9-26a956dd7597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59411413f40e41b3947be0864ca01a23, user_id=4b27955bfdf54f4a90b71accc81fce10, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.013892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.015864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.018729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2530c-dc23-44bd-97f9-26a956dd7597 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.033791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1003/2004] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:58 2022] PUT /identity/v3/projects/59411413f40e41b3947be0864ca01a23/users/4b27955bfdf54f4a90b71accc81fce10/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:59.045835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.046184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.049718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.049856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1002/2005] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:58 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:59.050463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.078587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] MFA Rules not processed for user `4b27955bfdf54f4a90b71accc81fce10`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:59.079847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:59.102013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:59.124596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43635159-e5be-4364-8d7a-23673b6ff321 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.129849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.130768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.131195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.131470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.132133 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.134328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.149016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1004/2006] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:59.156214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1003/2007] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:59 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:07:59.160139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.161026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.162667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:59.171541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fea5b-b4ba-4cd1-bd7e-52b01d9d7a6f None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.176946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.177562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.177843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.178118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.178768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.180409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.191716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1005/2008] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:59.195944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.205882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490411-b086-4128-b57a-21583dc127d0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.210524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.211113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.211418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.211692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.212326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.213943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.223701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1006/2009] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:07:59.227963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.229471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa6be-818f-4713-a0c0-221b5184a406 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.233130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426a62a-d64c-4e40-9679-1323e80f1fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.233760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a62a-d64c-4e40-9679-1323e80f1fee service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.234047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a62a-d64c-4e40-9679-1323e80f1fee service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.234322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a62a-d64c-4e40-9679-1323e80f1fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.237529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6723873-e784-4736-a59c-22cac5349db4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.242192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.242823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426a62a-d64c-4e40-9679-1323e80f1fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.242937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.243112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.243379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] PATH_INFO: `/v3/projects/830aaca9fe2a4e579b41dbfc63eefa26/users/ab256bc18de34850898ac60f007fc5f5/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.244263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426a62a-d64c-4e40-9679-1323e80f1fee service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.253616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1004/2010] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:07:59.261334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=830aaca9fe2a4e579b41dbfc63eefa26, user_id=ab256bc18de34850898ac60f007fc5f5, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.264009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.279403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1007/2011] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:59 2022] PUT /identity/v3/projects/830aaca9fe2a4e579b41dbfc63eefa26/users/ab256bc18de34850898ac60f007fc5f5/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:07:59.289879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.290164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.290439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.318678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] MFA Rules not processed for user `ab256bc18de34850898ac60f007fc5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:59.320023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:59.388084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1005/2012] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:07:59.392639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.461656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a75082-6fdb-43f6-b0ac-b9e48fc94992 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.469786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.470402 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.470681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.470971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.471573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.473528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.495069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:59.511040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1008/2013] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:07:59 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:59.514688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.526987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b0233-3197-4527-8a2e-4dd7fb6d3ce6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.600078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.600726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.601035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.601306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.601973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.603879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.614572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:07:59.632846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1006/2014] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:07:59 2022] POST /identity/v3/users => generated 308 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:07:59.635150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.645777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fc71-f1fd-4c40-92a9-35b5d2d65ac6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.650644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.651394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.651681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.652035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.652770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.654613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.666269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1009/2015] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:59.670604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.680580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f09313-30d9-4b35-8236-7fd7a21c6af8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.685394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.686070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.686326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.686594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] PATH_INFO: `/v3/projects/154c9f0c35844799b674a8f3d535817a/users/49da18cdb60d4306b8edcb622d90be42/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.706057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154c9f0c35844799b674a8f3d535817a, user_id=49da18cdb60d4306b8edcb622d90be42, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.708935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.723042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1007/2016] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:59 2022] PUT /identity/v3/projects/154c9f0c35844799b674a8f3d535817a/users/49da18cdb60d4306b8edcb622d90be42/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:59.726959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.737943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9dd8-b77b-423e-bf7a-26dcda9f2e03 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.797331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10612eac-2622-4e3d-a4ea-a932ce8cc332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.797973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612eac-2622-4e3d-a4ea-a932ce8cc332 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.798250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612eac-2622-4e3d-a4ea-a932ce8cc332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.798522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10612eac-2622-4e3d-a4ea-a932ce8cc332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.799187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10612eac-2622-4e3d-a4ea-a932ce8cc332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.800835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10612eac-2622-4e3d-a4ea-a932ce8cc332 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.811002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1010/2017] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:07:59.815315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:07:59.825806 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d5c0d-f50d-4d91-a3cb-be8c9c623835 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:07:59.830645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:07:59.831302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.831603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.831881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] PATH_INFO: `/v3/projects/154c9f0c35844799b674a8f3d535817a/users/49da18cdb60d4306b8edcb622d90be42/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.833865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154c9f0c35844799b674a8f3d535817a, user_id=49da18cdb60d4306b8edcb622d90be42, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:07:59.836518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:07:59.846697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1008/2018] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:07:59 2022] PUT /identity/v3/projects/154c9f0c35844799b674a8f3d535817a/users/49da18cdb60d4306b8edcb622d90be42/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:07:59.859498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912097-7946-4a86-997b-72439e7e9050 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:07:59.859848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912097-7946-4a86-997b-72439e7e9050 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:07:59.860122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912097-7946-4a86-997b-72439e7e9050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:07:59.897133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-70912097-7946-4a86-997b-72439e7e9050 None None] MFA Rules not processed for user `49da18cdb60d4306b8edcb622d90be42`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:07:59.898263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-70912097-7946-4a86-997b-72439e7e9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:07:59.974221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1011/2019] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:07:59 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:07:59.987350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:00.007531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70912097-7946-4a86-997b-72439e7e9050 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:00.009182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-70912097-7946-4a86-997b-72439e7e9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.046843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1c47-0406-4231-b1e6-38473f6af226 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:00.051279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6319d0-f5bb-4c0a-a189-447b23ca7976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:00.051893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6319d0-f5bb-4c0a-a189-447b23ca7976 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.052163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6319d0-f5bb-4c0a-a189-447b23ca7976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.052426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6319d0-f5bb-4c0a-a189-447b23ca7976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.061919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6319d0-f5bb-4c0a-a189-447b23ca7976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:00.063858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6319d0-f5bb-4c0a-a189-447b23ca7976 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:00.073585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1009/2020] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:07:59 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:00.078482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70912097-7946-4a86-997b-72439e7e9050 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:00.083073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:00.084376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.084655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.085139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] PATH_INFO: `/v3/users/2681f2ebaec541609438732f4ed49113` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.086432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2681f2ebaec541609438732f4ed49113)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:00.088331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:00.094206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:00.143305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2681f2ebaec541609438732f4ed49113'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.156058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2681f2ebaec541609438732f4ed49113'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.156875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2681f2ebaec541609438732f4ed49113'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.158055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2681f2ebaec541609438732f4ed49113'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.165880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2681f2ebaec541609438732f4ed49113'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.180266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1012/2021] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:00 2022] DELETE /identity/v3/users/2681f2ebaec541609438732f4ed49113 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:00.185006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79095cfa-73c6-4172-a851-9a195464213c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.185356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79095cfa-73c6-4172-a851-9a195464213c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.185704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79095cfa-73c6-4172-a851-9a195464213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.207945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-79095cfa-73c6-4172-a851-9a195464213c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:00.209183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-79095cfa-73c6-4172-a851-9a195464213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.237524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:00.239198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.272057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1010/2022] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:00.284779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79095cfa-73c6-4172-a851-9a195464213c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:00.286292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-79095cfa-73c6-4172-a851-9a195464213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.306863 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9cf77-ccc0-48ef-bea9-1da7542c42f6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:00.312159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:00.313025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.313406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.313787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] PATH_INFO: `/v3/users/ab256bc18de34850898ac60f007fc5f5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.314965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab256bc18de34850898ac60f007fc5f5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:00.317076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:00.354001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79095cfa-73c6-4172-a851-9a195464213c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:00.357866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb470860-7ac8-447d-9977-b84dd42a9d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:00.358586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb470860-7ac8-447d-9977-b84dd42a9d12 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.358920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb470860-7ac8-447d-9977-b84dd42a9d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.359125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb470860-7ac8-447d-9977-b84dd42a9d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.369118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb470860-7ac8-447d-9977-b84dd42a9d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:00.370204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab256bc18de34850898ac60f007fc5f5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.370552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb470860-7ac8-447d-9977-b84dd42a9d12 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:00.380342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1011/2023] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:00.382607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab256bc18de34850898ac60f007fc5f5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.383598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab256bc18de34850898ac60f007fc5f5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.384448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab256bc18de34850898ac60f007fc5f5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.391681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab256bc18de34850898ac60f007fc5f5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.404678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1013/2024] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:00 2022] DELETE /identity/v3/users/ab256bc18de34850898ac60f007fc5f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:00.409487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.409890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.410230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.418633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:00.433600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:00.434949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.503737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1012/2025] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:00.514182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:00.515744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.522578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:00.584098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63262d90-6b1e-4a16-b44d-b4b9b9e97e9e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:00.590192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b826-83e5-4c8c-964b-fb31fce01d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:00.590877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b826-83e5-4c8c-964b-fb31fce01d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.591156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b826-83e5-4c8c-964b-fb31fce01d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.591444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b826-83e5-4c8c-964b-fb31fce01d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.602384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b826-83e5-4c8c-964b-fb31fce01d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:00.604041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b826-83e5-4c8c-964b-fb31fce01d25 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:00.616209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1014/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:00.848833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:00.850036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:00.866975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58391727-ca8f-43d6-9031-dbbde5682a03 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:00.872322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:00.873059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:00.873331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:00.873930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] PATH_INFO: `/v3/projects/ac7cd908b92a40d98a72446aa9775c68` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:00.875343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7cd908b92a40d98a72446aa9775c68)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:00.877984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:00.965515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7cd908b92a40d98a72446aa9775c68', 'request_id': 'req-1089cdc7-ddd6-44c9-a698-37295efb36de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.972278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7cd908b92a40d98a72446aa9775c68', 'request_id': 'req-1089cdc7-ddd6-44c9-a698-37295efb36de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:00.982659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7cd908b92a40d98a72446aa9775c68', 'request_id': 'req-1089cdc7-ddd6-44c9-a698-37295efb36de'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.000511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] The token cache is being invalidate because project ac7cd908b92a40d98a72446aa9775c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:01.001039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.001698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.003207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1013/2027] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:00 2022] DELETE /identity/v3/projects/ac7cd908b92a40d98a72446aa9775c68 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:01.009144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053070-cfd9-4d82-95f5-02f034ffbae7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.009700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053070-cfd9-4d82-95f5-02f034ffbae7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.010820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053070-cfd9-4d82-95f5-02f034ffbae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.032366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a3053070-cfd9-4d82-95f5-02f034ffbae7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:01.034060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a3053070-cfd9-4d82-95f5-02f034ffbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.097001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.098464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.100416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1015/2028] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:01.108256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.109183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.109537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.115952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089cdc7-ddd6-44c9-a698-37295efb36de admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.125502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.127098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.127383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.127735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] PATH_INFO: `/v3/projects/830aaca9fe2a4e579b41dbfc63eefa26` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.128848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=830aaca9fe2a4e579b41dbfc63eefa26)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.131033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.143085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:01.144538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.153852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1016/2029] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:01.158089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.168578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586bddd-ae96-4e18-8ade-0a3302cc084d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.182447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830aaca9fe2a4e579b41dbfc63eefa26', 'request_id': 'req-08eef4d6-91db-4ff5-80e2-21d403744bcf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.189038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830aaca9fe2a4e579b41dbfc63eefa26', 'request_id': 'req-08eef4d6-91db-4ff5-80e2-21d403744bcf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.196754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830aaca9fe2a4e579b41dbfc63eefa26', 'request_id': 'req-08eef4d6-91db-4ff5-80e2-21d403744bcf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.209041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] The token cache is being invalidate because project 830aaca9fe2a4e579b41dbfc63eefa26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:01.209328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.209985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.211539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1014/2030] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:01 2022] DELETE /identity/v3/projects/830aaca9fe2a4e579b41dbfc63eefa26 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:01.215484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.216820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.226577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.227418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.227538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:01.227645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.227892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.228729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:01.229091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.230832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.246590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1017/2031] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:01.247590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.250235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.262662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b39a-36af-4459-b290-a0b4a837f129 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.267531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.268443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.268721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.269017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.269651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.271691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.282193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef4d6-91db-4ff5-80e2-21d403744bcf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.286938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.287568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.287843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.288131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] PATH_INFO: `/v3/users/49da18cdb60d4306b8edcb622d90be42` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.289690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49da18cdb60d4306b8edcb622d90be42)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.291651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.300591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1018/2032] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:01.304577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.319527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:01.338707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49da18cdb60d4306b8edcb622d90be42'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.345610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49da18cdb60d4306b8edcb622d90be42'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.354425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49da18cdb60d4306b8edcb622d90be42'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.355104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49da18cdb60d4306b8edcb622d90be42'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.367943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49da18cdb60d4306b8edcb622d90be42'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.370654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ef1a-30c4-4d31-a5f0-344205cb0734 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.374209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1015/2033] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:01 2022] DELETE /identity/v3/users/49da18cdb60d4306b8edcb622d90be42 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:01.375745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.376355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.376635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.376954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.377667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.379512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.400383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1019/2034] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:01.404458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.406010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.470589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42eb1b-562b-42e1-b8a3-0acbf9346db4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.475770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.476386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.476660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.477055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.477711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.479304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.489993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1016/2035] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:01.493937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.504473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51d30-b7ae-4d57-a18d-0c8ed1b44441 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.510136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43de0a-5d5b-48f2-a3ee-0288b0c5622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.510871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43de0a-5d5b-48f2-a3ee-0288b0c5622c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.511167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43de0a-5d5b-48f2-a3ee-0288b0c5622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.511412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43de0a-5d5b-48f2-a3ee-0288b0c5622c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.512058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43de0a-5d5b-48f2-a3ee-0288b0c5622c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.513769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43de0a-5d5b-48f2-a3ee-0288b0c5622c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.524663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1020/2036] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:01.528911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.540143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d878b-225a-4663-be31-7f065a3ca2ac admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.545150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.545817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.546095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.546384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] PATH_INFO: `/v3/projects/127499906094423fbbe14151cc1e0cf4/users/ec272b4f959c4e039f23f28990fc82ab/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.561679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=127499906094423fbbe14151cc1e0cf4, user_id=ec272b4f959c4e039f23f28990fc82ab, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.564540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.573792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:01.579880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1017/2037] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:01 2022] PUT /identity/v3/projects/127499906094423fbbe14151cc1e0cf4/users/ec272b4f959c4e039f23f28990fc82ab/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:01.591949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374699-475c-403b-ac45-25f45a916204 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.592223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374699-475c-403b-ac45-25f45a916204 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.592495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374699-475c-403b-ac45-25f45a916204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.620571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4b374699-475c-403b-ac45-25f45a916204 None None] MFA Rules not processed for user `ec272b4f959c4e039f23f28990fc82ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:01.621818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b374699-475c-403b-ac45-25f45a916204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.659695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.663581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.720061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1021/2038] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:01.731384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374699-475c-403b-ac45-25f45a916204 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.732709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b374699-475c-403b-ac45-25f45a916204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.741293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9074ac-c20a-46ee-8c37-3f91cc4dfd3c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.746046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.746682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.746959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.747231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] PATH_INFO: `/v3/projects/154c9f0c35844799b674a8f3d535817a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.748351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=154c9f0c35844799b674a8f3d535817a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.750612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.789885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374699-475c-403b-ac45-25f45a916204 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.800590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154c9f0c35844799b674a8f3d535817a', 'request_id': 'req-f001843d-aace-4cea-999d-227d46b21e3c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.806413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154c9f0c35844799b674a8f3d535817a', 'request_id': 'req-f001843d-aace-4cea-999d-227d46b21e3c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.815805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154c9f0c35844799b674a8f3d535817a', 'request_id': 'req-f001843d-aace-4cea-999d-227d46b21e3c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.827083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:01.828028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] The token cache is being invalidate because project 154c9f0c35844799b674a8f3d535817a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:01.828361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.829159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f001843d-aace-4cea-999d-227d46b21e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:01.830889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1018/2039] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:01 2022] DELETE /identity/v3/projects/154c9f0c35844799b674a8f3d535817a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:01.835505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.835789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.836057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.844715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.845363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.845637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.845905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.847700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.856561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:01.857771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.910899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.912346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac1714-ebe5-4cc0-a8b8-6dad5404f5d3 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.917816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1019/2040] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:01.921795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1022/2041] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:01.924715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.925208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.925488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.925760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.926143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.941559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73f56-dddd-453a-97cc-49c6a2ed574b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:01.945409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:01.946252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:01.946565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:01.946768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] PATH_INFO: `/v3/users/4b27955bfdf54f4a90b71accc81fce10` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:01.947942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b27955bfdf54f4a90b71accc81fce10)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:01.950029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:01.957824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:01.960669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:01.975097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1023/2042] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:01.979874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:01.988788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:02.012384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b486f-f230-4b4c-8bb4-685da44eee14 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.017572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b27955bfdf54f4a90b71accc81fce10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.020128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.022208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.022610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.022786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.024111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:02.024697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.026471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.030010 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b27955bfdf54f4a90b71accc81fce10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.039704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b27955bfdf54f4a90b71accc81fce10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.041028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b27955bfdf54f4a90b71accc81fce10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.042549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1024/2043] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:02.050050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.053244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:02.068369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7250409d-962c-4f25-847e-0574a5b747c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b27955bfdf54f4a90b71accc81fce10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.069201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af640b2-263e-4a1b-8e93-b32093d4220e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.075545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.076418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.076757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.077079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.077822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.079983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.084171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1020/2044] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:01 2022] DELETE /identity/v3/users/4b27955bfdf54f4a90b71accc81fce10 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:02.086690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.087204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.087884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.117800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:02.121796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:02.129049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1025/2045] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:02.133552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.214038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34aad6-28ea-43aa-bd83-4b19e4554a51 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.219271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.219889 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.220163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.220428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.221655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.223497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1021/2046] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:02.225208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.234083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.236101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:02.259115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1026/2047] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/users => generated 282 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:02.260184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.272581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df84dd-a515-4e50-92c6-9c806501b1a7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.301357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.301357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.301357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.301357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.301995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.301995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.312613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1027/2048] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:02.315015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.326197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a80c33-f47d-47ff-ba32-506a377453db admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.331204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.332037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.332829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.333200 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.333910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.335563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.352766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1028/2049] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:02.352982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffabf33-9c7d-403b-87b2-c34f271aac68 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.354187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.366533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645cf94-e14a-4a29-8cd6-12491a490cc4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.374309 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1e059-81a7-48e0-b15d-84ff31e0c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.375831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e059-81a7-48e0-b15d-84ff31e0c992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.376106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e059-81a7-48e0-b15d-84ff31e0c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.376372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e059-81a7-48e0-b15d-84ff31e0c992 admin admin] PATH_INFO: `/v3/projects/b198cf8d7be04509896d9c820f491f11/users/33b2bae257bd4c7f8dc2241b6727d126/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.405485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1e059-81a7-48e0-b15d-84ff31e0c992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b198cf8d7be04509896d9c820f491f11, user_id=33b2bae257bd4c7f8dc2241b6727d126, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.405485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1e059-81a7-48e0-b15d-84ff31e0c992 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.405485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:02.430915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1029/2050] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:02 2022] PUT /identity/v3/projects/b198cf8d7be04509896d9c820f491f11/users/33b2bae257bd4c7f8dc2241b6727d126/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:02.442855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.443524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.444021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.461619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.462649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.463045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.463318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.474676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.476188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.480431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] MFA Rules not processed for user `33b2bae257bd4c7f8dc2241b6727d126`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:02.482067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:02.503124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1022/2051] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:02.566934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1030/2052] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:02.568028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.573960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:02.587580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e4746-728d-41c8-a0cd-64999b24c627 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.676854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.677294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.677706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.677988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.678712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.681136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.727400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1023/2053] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:02.728634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.739513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911541b8-1f61-4453-9c29-dfbc5a48776e None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.807730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.808415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.808715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.809012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.809658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.811805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.833835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.835586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:02.839703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1031/2054] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:02.843474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.851577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bf9c3-bf72-4dd6-99cf-8b347d479a48 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.854539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0dd6-d02b-4b3a-a6a7-e0ca15796dc9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.857512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.859436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.859931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.860077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.860159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] PATH_INFO: `/v3/projects/59411413f40e41b3947be0864ca01a23` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.860748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.860986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.861491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59411413f40e41b3947be0864ca01a23)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.861607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.862387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.863443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.864227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.875741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1032/2055] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:02.879976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.890891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce35be2-cead-43d0-840a-272272539077 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:02.896331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:02.897052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.897338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.897625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] PATH_INFO: `/v3/projects/e1b9a653de7f4d90af562a8916b4ffe1/users/812eee226237424c900518eefb883164/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.913540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b9a653de7f4d90af562a8916b4ffe1, user_id=812eee226237424c900518eefb883164, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:02.916032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59411413f40e41b3947be0864ca01a23', 'request_id': 'req-6820f763-8af8-4545-bd92-4e1c9f670f8e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.916237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:02.922464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59411413f40e41b3947be0864ca01a23', 'request_id': 'req-6820f763-8af8-4545-bd92-4e1c9f670f8e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.930209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59411413f40e41b3947be0864ca01a23', 'request_id': 'req-6820f763-8af8-4545-bd92-4e1c9f670f8e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.930381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1033/2056] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:02 2022] PUT /identity/v3/projects/e1b9a653de7f4d90af562a8916b4ffe1/users/812eee226237424c900518eefb883164/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:02.934237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:02.944358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] The token cache is being invalidate because project 59411413f40e41b3947be0864ca01a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:02.944652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.945362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6820f763-8af8-4545-bd92-4e1c9f670f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:02.946960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1024/2057] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:02 2022] DELETE /identity/v3/projects/59411413f40e41b3947be0864ca01a23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:02.953274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94654-37ce-4ca7-bde6-e713e5cce441 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:02.953684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94654-37ce-4ca7-bde6-e713e5cce441 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:02.953969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94654-37ce-4ca7-bde6-e713e5cce441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:02.973648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-71e94654-37ce-4ca7-bde6-e713e5cce441 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:02.974933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-71e94654-37ce-4ca7-bde6-e713e5cce441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:02.978366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:03.003477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1341d-b736-4914-b8ea-3bea4b7bde25 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.008117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.008727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.009030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.009322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.009933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.011514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.021500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1034/2058] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:03.025880 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.027658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:03.036033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1025/2059] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:03.040352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47565626-8a25-45c6-b5b7-7bff1a1a4e94 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.043496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.043788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.044050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.045406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8c0e-2974-4802-9aa9-790cb2988682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.046065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8c0e-2974-4802-9aa9-790cb2988682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.046345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8c0e-2974-4802-9aa9-790cb2988682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.046637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8c0e-2974-4802-9aa9-790cb2988682 admin admin] PATH_INFO: `/v3/projects/e1b9a653de7f4d90af562a8916b4ffe1/users/812eee226237424c900518eefb883164/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.048598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b8c0e-2974-4802-9aa9-790cb2988682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b9a653de7f4d90af562a8916b4ffe1, user_id=812eee226237424c900518eefb883164, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.051271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b8c0e-2974-4802-9aa9-790cb2988682 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.062013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1035/2060] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:03 2022] PUT /identity/v3/projects/e1b9a653de7f4d90af562a8916b4ffe1/users/812eee226237424c900518eefb883164/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:03.066625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:03.068327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:03.074082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:03.074727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.074912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.075361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.105513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] MFA Rules not processed for user `812eee226237424c900518eefb883164`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:03.106688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:03.133306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1026/2061] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:03.137816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.147933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499cf10-31da-4257-a747-2e5ebd2f31d1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.153194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.153779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.154052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.154612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.154981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:03.155295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.156894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.172178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1027/2062] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:03.173442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.181711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1036/2063] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:03.183829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eceaf-253e-49d0-82a7-7e09b4e79753 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.190334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.190967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.191243 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.191513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.192143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.193719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.194187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.195390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:03.226146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1028/2064] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:03 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:03.230789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.259155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92e0e7-518e-4fbb-b9ff-6781652c0d71 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.295802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa537f2-4ab9-44ae-b3cb-64c1785268a3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.300825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.301489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.301801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.302100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.302789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.304958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.311589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.312928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.312928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.313503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.327907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:03.337168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1029/2065] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:03 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:03.338765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.351434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13cef-be25-4f04-af95-3dbf96cbb738 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.356979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.358398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.358672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.358943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.359601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.361546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.371624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1030/2066] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:03.376067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.386324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abc423-4a42-4314-865e-2f1766a7d931 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.391260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.392147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b258d85-23cd-4a8a-ba3c-7df46c4a7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.393320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258d85-23cd-4a8a-ba3c-7df46c4a7844 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.394107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.394219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258d85-23cd-4a8a-ba3c-7df46c4a7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.394219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258d85-23cd-4a8a-ba3c-7df46c4a7844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.394219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b258d85-23cd-4a8a-ba3c-7df46c4a7844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.396390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b258d85-23cd-4a8a-ba3c-7df46c4a7844 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.405293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1037/2067] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:03.412836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1031/2068] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:03.417163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.430497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e0781-5712-4ebc-8edb-0cd1882ac8d7 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.436589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.437390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.437736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.438090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] PATH_INFO: `/v3/projects/a292d8d312894aa0a52715abce9746bc/users/c17d9157502a418b80196e146493e02f/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.458524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a292d8d312894aa0a52715abce9746bc, user_id=c17d9157502a418b80196e146493e02f, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.461429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.482087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1038/2069] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:03 2022] PUT /identity/v3/projects/a292d8d312894aa0a52715abce9746bc/users/c17d9157502a418b80196e146493e02f/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:03.495232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.495600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.495927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.532084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] MFA Rules not processed for user `c17d9157502a418b80196e146493e02f`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:03.533254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:03.569962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:03.614066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1032/2070] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:03.638312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:03.640356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:03.720999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c504b1-63cc-4c2d-9cc5-6d31a2a1f277 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:03.724955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad644f-af54-4f8b-b2a4-7269f645e63e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:03.725767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad644f-af54-4f8b-b2a4-7269f645e63e service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:03.726032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad644f-af54-4f8b-b2a4-7269f645e63e service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:03.726367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad644f-af54-4f8b-b2a4-7269f645e63e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:03.740779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad644f-af54-4f8b-b2a4-7269f645e63e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:03.742350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad644f-af54-4f8b-b2a4-7269f645e63e service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:03.753340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1039/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:04.054758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:04.124181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb26f-f7cc-4044-89f3-79377a623ff0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:04.128709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:04.129392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:04.129670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:04.129941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] PATH_INFO: `/v3/users/33b2bae257bd4c7f8dc2241b6727d126` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:04.131067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b2bae257bd4c7f8dc2241b6727d126)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:04.133252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:04.187586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b2bae257bd4c7f8dc2241b6727d126'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.195385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b2bae257bd4c7f8dc2241b6727d126'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.203471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b2bae257bd4c7f8dc2241b6727d126'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.204464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b2bae257bd4c7f8dc2241b6727d126'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.219415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b2bae257bd4c7f8dc2241b6727d126'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.227739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1033/2072] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:04 2022] DELETE /identity/v3/users/33b2bae257bd4c7f8dc2241b6727d126 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:04.232264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:04.232723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:04.232903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:04.253244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:04.254445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:04.316009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1040/2073] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:04.325982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:04.327376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:04.389338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f3b10-6be8-4966-9018-0705ed9ea8ac admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:04.393607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:04.394246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:04.394526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:04.394799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:04.401930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:04.404515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:04.407445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:04.418607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1034/2074] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:04.708045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:04.709726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:04.728700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35455daa-2c1c-4273-a19c-54f147c93977 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:04.734229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:04.734801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:04.735083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:04.735411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] PATH_INFO: `/v3/projects/b198cf8d7be04509896d9c820f491f11` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:04.736509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b198cf8d7be04509896d9c820f491f11)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:04.738334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:04.770337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:04.788870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b198cf8d7be04509896d9c820f491f11', 'request_id': 'req-89f85a43-3a24-434e-ac50-f9f52a8dbba2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.795835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b198cf8d7be04509896d9c820f491f11', 'request_id': 'req-89f85a43-3a24-434e-ac50-f9f52a8dbba2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.801929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b198cf8d7be04509896d9c820f491f11', 'request_id': 'req-89f85a43-3a24-434e-ac50-f9f52a8dbba2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.816090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] The token cache is being invalidate because project b198cf8d7be04509896d9c820f491f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:04.816406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.817131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.818664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1041/2075] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:04 2022] DELETE /identity/v3/projects/b198cf8d7be04509896d9c820f491f11 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:04.823203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:04.832933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe652-4a39-43f5-b5f8-13595424bd3e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:04.894097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:04.894732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:04.895006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:04.895276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] PATH_INFO: `/v3/users/812eee226237424c900518eefb883164` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:04.896377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=812eee226237424c900518eefb883164)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:04.898496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:04.950237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812eee226237424c900518eefb883164'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.957040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812eee226237424c900518eefb883164'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.965752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812eee226237424c900518eefb883164'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.966480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812eee226237424c900518eefb883164'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.979911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812eee226237424c900518eefb883164'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:04.986667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1035/2076] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:04 2022] DELETE /identity/v3/users/812eee226237424c900518eefb883164 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:05.308968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:05.312275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:05.359326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:05.361008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:05.365097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85a43-3a24-434e-ac50-f9f52a8dbba2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:05.445880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9dad8-2018-49fd-b790-8a20a15c6727 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:05.448915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:05.449566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.449783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:05.449899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.450109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] PATH_INFO: `/v3/projects/e1b9a653de7f4d90af562a8916b4ffe1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.450577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.450912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.451253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.451788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b9a653de7f4d90af562a8916b4ffe1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:05.453640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:05.456362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:05.490506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:05.524474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b9a653de7f4d90af562a8916b4ffe1', 'request_id': 'req-580491e3-6f3d-48e5-8a9a-27b2c0db1225'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:05.531240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b9a653de7f4d90af562a8916b4ffe1', 'request_id': 'req-580491e3-6f3d-48e5-8a9a-27b2c0db1225'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:05.535763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:05.537650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda26896-df4e-465b-8b7b-681ca01a0a97 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:05.541572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b9a653de7f4d90af562a8916b4ffe1', 'request_id': 'req-580491e3-6f3d-48e5-8a9a-27b2c0db1225'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:05.548596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1036/2077] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:05.564876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] The token cache is being invalidate because project e1b9a653de7f4d90af562a8916b4ffe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:05.565349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:05.566205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-580491e3-6f3d-48e5-8a9a-27b2c0db1225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:05.568180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1042/2078] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:05 2022] DELETE /identity/v3/projects/e1b9a653de7f4d90af562a8916b4ffe1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:05.573186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.573560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.573917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.597340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:05.598848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:05.682002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1037/2079] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:05.689472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.689760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.690036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.712682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:05.714146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:05.732652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1043/2080] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:05.733682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:05.755775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fa395-d026-434b-8094-b86463fa75c0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:05.763037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:05.765299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.765599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.765878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.768031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:05.768342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:05.769982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:05.784039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1038/2081] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:05.788582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:05.798658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45d7ec-e58f-4bb5-b286-77f061f70771 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:05.805435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:05.806124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.806792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.806792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.807393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:05.809409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:05.840470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1044/2082] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:05 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:05.844932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:05.856621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88b2b9-e054-4072-a399-0d13e14cbd3b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:05.917592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:05.918230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.918511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.918817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.919458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:05.921533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:05.947945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1039/2083] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:05 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:05.953741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:05.965987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc67c1-a9a6-4d32-8a1a-545bef708d04 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:05.971537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:05.972416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:05.972817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:05.973329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:05.974367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:05.976637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:05.988217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1045/2084] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:05.992185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.003381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceacbd9-e01d-4b07-a901-c1edc43db867 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.009911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35013a7-ba7d-406e-ac85-d2f5bcbb1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.010628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35013a7-ba7d-406e-ac85-d2f5bcbb1e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.010886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35013a7-ba7d-406e-ac85-d2f5bcbb1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.011240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35013a7-ba7d-406e-ac85-d2f5bcbb1e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.011925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35013a7-ba7d-406e-ac85-d2f5bcbb1e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.013573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35013a7-ba7d-406e-ac85-d2f5bcbb1e1a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.025029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1040/2085] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:06.029417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.038976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:06.043165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90509145-8afa-4c75-80b2-507d5f85fd6f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.050052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.050714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.051197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.051486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] PATH_INFO: `/v3/projects/14ce1d488e3c4223955cde2cc389bd9e/users/4a545132a8b24fbc9d05546fa170e17c/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.067775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ce1d488e3c4223955cde2cc389bd9e, user_id=4a545132a8b24fbc9d05546fa170e17c, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.070803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.085872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1046/2086] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:06 2022] PUT /identity/v3/projects/14ce1d488e3c4223955cde2cc389bd9e/users/4a545132a8b24fbc9d05546fa170e17c/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:06.096684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.097006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.097258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.132992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] MFA Rules not processed for user `4a545132a8b24fbc9d05546fa170e17c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:06.134237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:06.155102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:06.205452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1041/2087] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:06.210058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.271512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b03ad7-877f-4b02-939c-7fc6532b9d16 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.277691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.278463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.278742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.279010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.279679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.281699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.310883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1047/2088] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:06 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:06.314910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.326436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70be70-c0cc-4d2d-8ca7-c38544f620d9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.389708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.390396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.390513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.390840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.391405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.393398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.417718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1042/2089] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:06 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:06.421702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.432641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e2dc4-3a76-4019-9c4b-f30736651164 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.438061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.438677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.439114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.439390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.440033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.441657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.454362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1048/2090] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:06.464530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.476726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa49ef-f22f-48cb-80d7-31972afa254e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.481385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.482063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.482338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.482609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] PATH_INFO: `/v3/projects/ed9fd698292946c2acd3d1c7c179d898/users/48d686a3c3bd4babaaa574d3931935a8/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.503390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9fd698292946c2acd3d1c7c179d898, user_id=48d686a3c3bd4babaaa574d3931935a8, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.505327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.522364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1043/2091] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:06 2022] PUT /identity/v3/projects/ed9fd698292946c2acd3d1c7c179d898/users/48d686a3c3bd4babaaa574d3931935a8/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:06.526747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.538991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879e581-7204-4a20-8a1d-8a5aa10472a2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.620739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5b31d-a2af-4faa-801e-ecc9095ae18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.621397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5b31d-a2af-4faa-801e-ecc9095ae18c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.622005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5b31d-a2af-4faa-801e-ecc9095ae18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.622284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5b31d-a2af-4faa-801e-ecc9095ae18c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.623129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5b31d-a2af-4faa-801e-ecc9095ae18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.625191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5b31d-a2af-4faa-801e-ecc9095ae18c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.636080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1049/2092] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:06.640045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.651860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9aa7e-869e-4a4f-8155-eee63ea0d7d3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.656786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.657483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.657755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.658023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] PATH_INFO: `/v3/projects/ed9fd698292946c2acd3d1c7c179d898/users/48d686a3c3bd4babaaa574d3931935a8/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.659926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9fd698292946c2acd3d1c7c179d898, user_id=48d686a3c3bd4babaaa574d3931935a8, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.662664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.690361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1044/2093] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:06 2022] PUT /identity/v3/projects/ed9fd698292946c2acd3d1c7c179d898/users/48d686a3c3bd4babaaa574d3931935a8/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:06.692005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.692291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.692562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.734561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] MFA Rules not processed for user `48d686a3c3bd4babaaa574d3931935a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:06.736344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:06.793981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:06.822578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1050/2094] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:06.834173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:06.835942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:06.895572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38424c-366e-4f76-908e-cd9f8a8ef8ec admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:06.899416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58c5a1-cca0-4082-9329-136fdfde0b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:06.900024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58c5a1-cca0-4082-9329-136fdfde0b56 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:06.900297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58c5a1-cca0-4082-9329-136fdfde0b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:06.900555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58c5a1-cca0-4082-9329-136fdfde0b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:06.911575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58c5a1-cca0-4082-9329-136fdfde0b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:06.913096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58c5a1-cca0-4082-9329-136fdfde0b56 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:06.927151 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1045/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:06.961581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:07.040630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3312a40-ea9f-43ad-a5e3-f98bd8e3db29 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:07.050657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:07.051434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:07.051774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:07.052110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] PATH_INFO: `/v3/users/4a545132a8b24fbc9d05546fa170e17c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:07.053645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a545132a8b24fbc9d05546fa170e17c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:07.055765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:07.108358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a545132a8b24fbc9d05546fa170e17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.134745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a545132a8b24fbc9d05546fa170e17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.135523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a545132a8b24fbc9d05546fa170e17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.136267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a545132a8b24fbc9d05546fa170e17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.143646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a545132a8b24fbc9d05546fa170e17c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.157583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1051/2096] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:06 2022] DELETE /identity/v3/users/4a545132a8b24fbc9d05546fa170e17c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:07.162349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:07.162703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:07.163043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:07.184172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:07.185522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:07.198179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:07.256341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1046/2097] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:07.270913 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:07.272476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:07.341343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635d585-8099-4a02-a1e0-3b911e05c53b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:07.344941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:07.345536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:07.345816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:07.346091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:07.355428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:07.357009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:07.361149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:07.369364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1052/2098] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:07.665073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:07.666546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:07.678959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8eefd-bcd5-4cc1-90a2-459a78d2bff7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:07.683923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:07.684569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:07.684919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:07.685197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] PATH_INFO: `/v3/projects/14ce1d488e3c4223955cde2cc389bd9e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:07.686351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ce1d488e3c4223955cde2cc389bd9e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:07.688286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:07.744116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ce1d488e3c4223955cde2cc389bd9e', 'request_id': 'req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.749905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ce1d488e3c4223955cde2cc389bd9e', 'request_id': 'req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.757987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ce1d488e3c4223955cde2cc389bd9e', 'request_id': 'req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.769764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] The token cache is being invalidate because project 14ce1d488e3c4223955cde2cc389bd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:07.770035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.770668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.772181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1047/2099] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:07 2022] DELETE /identity/v3/projects/14ce1d488e3c4223955cde2cc389bd9e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:07.776459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:07.788490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5e72f-6c92-4ee9-92cc-c8cc588ca125 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:07.853480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:07.854239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:07.854525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:07.854798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] PATH_INFO: `/v3/users/48d686a3c3bd4babaaa574d3931935a8` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:07.855933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d686a3c3bd4babaaa574d3931935a8)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:07.857928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:07.919125 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d686a3c3bd4babaaa574d3931935a8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.932946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d686a3c3bd4babaaa574d3931935a8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.933717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d686a3c3bd4babaaa574d3931935a8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.934418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d686a3c3bd4babaaa574d3931935a8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.945161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dee221bf-cbc1-4e28-a32b-989fb8839124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d686a3c3bd4babaaa574d3931935a8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:07.973060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1053/2100] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:07 2022] DELETE /identity/v3/users/48d686a3c3bd4babaaa574d3931935a8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:08.280957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.282428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:08.296644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3779c-5606-4d83-a6ed-d6cb9ccc4861 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.365887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.366539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.367191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.367191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] PATH_INFO: `/v3/projects/ed9fd698292946c2acd3d1c7c179d898` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.368458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9fd698292946c2acd3d1c7c179d898)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.370360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.416421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:08.423393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9fd698292946c2acd3d1c7c179d898', 'request_id': 'req-98f22a45-2f52-4189-8d5c-160ad1895213'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:08.430046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9fd698292946c2acd3d1c7c179d898', 'request_id': 'req-98f22a45-2f52-4189-8d5c-160ad1895213'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:08.437519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9fd698292946c2acd3d1c7c179d898', 'request_id': 'req-98f22a45-2f52-4189-8d5c-160ad1895213'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:08.450561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] The token cache is being invalidate because project ed9fd698292946c2acd3d1c7c179d898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:08.450850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:08.451491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-98f22a45-2f52-4189-8d5c-160ad1895213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:08.453009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1048/2101] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:08 2022] DELETE /identity/v3/projects/ed9fd698292946c2acd3d1c7c179d898 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:08.458109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.458625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.458720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.479012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:08.480221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:08.546469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1054/2102] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:08.554841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.555198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.555445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.576503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:08.577781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:08.597420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1049/2103] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:08.601833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.612400 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a1ca6-a51c-4730-bf2c-6b713feb0c47 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.617274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.617837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.618117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.618425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.619102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:08.619420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.621039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.634359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1055/2104] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:08.639076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.648822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb1536-0f1f-4fab-b44e-74dd0fe18082 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.654142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.654752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.655028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.655390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.655936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.657892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.700458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1050/2105] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:08 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:08.703341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.710411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:08.715057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc56674-a515-4e0b-9001-95a1d247a28c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.774917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.775536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.775856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.776120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.776753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.778742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.801513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1056/2106] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:08 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:08.805986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.818279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a31eb9-4d2b-42dc-9548-0220faf6f2fd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.823341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.824032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.824414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.824748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.825438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.827027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.837475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1051/2107] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:08.841750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.852260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c4d3-61bb-4acc-8aff-c16f20769256 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.858756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fd4f4-c20a-4a88-9e0c-9b9f7c05a4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.859384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fd4f4-c20a-4a88-9e0c-9b9f7c05a4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.859675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fd4f4-c20a-4a88-9e0c-9b9f7c05a4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.859940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fd4f4-c20a-4a88-9e0c-9b9f7c05a4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.860687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fd4f4-c20a-4a88-9e0c-9b9f7c05a4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.862398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fd4f4-c20a-4a88-9e0c-9b9f7c05a4d9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.874727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1057/2108] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:08.878993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:08.889130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf35ea-d195-4a59-8045-773321958956 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:08.893888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:08.894541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.894827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.895094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] PATH_INFO: `/v3/projects/71c07dd208654088af88bd8162c43e57/users/da50b6fabb9b4f7888b76bcd70fd152e/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:08.919095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c07dd208654088af88bd8162c43e57, user_id=da50b6fabb9b4f7888b76bcd70fd152e, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:08.921838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:08.938154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1052/2109] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:08 2022] PUT /identity/v3/projects/71c07dd208654088af88bd8162c43e57/users/da50b6fabb9b4f7888b76bcd70fd152e/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:08.952580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:08.953167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:08.953479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.000250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] MFA Rules not processed for user `da50b6fabb9b4f7888b76bcd70fd152e`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:09.001744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:09.095834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1058/2110] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:09.098256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.180672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb13a2-8e20-41a4-9c71-7dbef650f65a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.186094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.186715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.186995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.187270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.187911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.189874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.221497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1053/2111] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:09 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:09.222724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.233641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaae802-0f78-471d-80ff-901acaeada9c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.314011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.314625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.314901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.315168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.315829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.317841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.343869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1059/2112] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:09 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:09.348273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.360571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063a5d-f99a-431e-8161-546b245a1592 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.366095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.366861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.367202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.367494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.368311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.370003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.382421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1054/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:09.386504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.392011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:09.400305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878f3d9-8b12-45c5-8340-1ff7afc458c1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.405245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.405950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.406228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.406781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] PATH_INFO: `/v3/projects/0b67127294c249d58b1a0c5237acd9f4/users/c61c814053464814a09d55b1cd96240c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.424014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b67127294c249d58b1a0c5237acd9f4, user_id=c61c814053464814a09d55b1cd96240c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.426737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.443236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1060/2114] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:09 2022] PUT /identity/v3/projects/0b67127294c249d58b1a0c5237acd9f4/users/c61c814053464814a09d55b1cd96240c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:09.448988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.461951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339303af-786a-494f-8b53-4df97795cfa9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.514691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:09.538322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178d09e-b05c-4f60-b21d-6c001c985c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.538943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d09e-b05c-4f60-b21d-6c001c985c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.539340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d09e-b05c-4f60-b21d-6c001c985c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.539710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d09e-b05c-4f60-b21d-6c001c985c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.540636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178d09e-b05c-4f60-b21d-6c001c985c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.542798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178d09e-b05c-4f60-b21d-6c001c985c9d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.555485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1055/2115] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:09.563294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.580534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ed83d-2639-459d-8d14-24a83507668b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.596047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.596504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.596965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.597314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] PATH_INFO: `/v3/projects/0b67127294c249d58b1a0c5237acd9f4/users/c61c814053464814a09d55b1cd96240c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.599533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b67127294c249d58b1a0c5237acd9f4, user_id=c61c814053464814a09d55b1cd96240c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.602589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.621050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1061/2116] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:09 2022] PUT /identity/v3/projects/0b67127294c249d58b1a0c5237acd9f4/users/c61c814053464814a09d55b1cd96240c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:09.627755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.627907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.628138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.661487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] MFA Rules not processed for user `c61c814053464814a09d55b1cd96240c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:09.662727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:09.743758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1056/2117] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:09.755015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.756859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:09.823205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f86e27-3be1-442f-8017-4f57a1bc16b1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.827130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.827767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.828041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.828311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:09.838438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:09.839869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:09.850606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1062/2118] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:09.957436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:09.967685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd634a7-5203-4ea7-957d-cfb96a8cf8d2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:09.971622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791445-21be-4319-94eb-c381f39df16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:09.972250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791445-21be-4319-94eb-c381f39df16f service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:09.972532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791445-21be-4319-94eb-c381f39df16f service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:09.972846 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791445-21be-4319-94eb-c381f39df16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:10.031408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791445-21be-4319-94eb-c381f39df16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:10.032880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791445-21be-4319-94eb-c381f39df16f service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:10.042139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1057/2119] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:12.448013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:12.449694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:12.516527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeabfa0-d6e2-401c-919f-12f785cf3c4b service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:12.521417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:12.522045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:12.522323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:12.522619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] PATH_INFO: `/v3/users/ec272b4f959c4e039f23f28990fc82ab` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:12.523833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec272b4f959c4e039f23f28990fc82ab)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:12.525851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:12.577901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec272b4f959c4e039f23f28990fc82ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.589626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec272b4f959c4e039f23f28990fc82ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.590305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec272b4f959c4e039f23f28990fc82ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.590912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec272b4f959c4e039f23f28990fc82ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.595790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:12.599256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec272b4f959c4e039f23f28990fc82ab'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.615089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1063/2120] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:12 2022] DELETE /identity/v3/users/ec272b4f959c4e039f23f28990fc82ab => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:12.619648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:12.620107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:12.620200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:12.639577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:12.640762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:12.661897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:12.663679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:12.700350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:12.714379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1058/2121] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:12.725600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:12.727067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:12.743212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ad457-cae7-4826-880b-4e8239b78514 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:12.748038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:12.749024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:12.749297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:12.749605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] PATH_INFO: `/v3/users/da50b6fabb9b4f7888b76bcd70fd152e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:12.750748 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da50b6fabb9b4f7888b76bcd70fd152e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:12.752646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:12.798919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110325c4-1220-4d88-9745-4aa7e74a0bc5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:12.802760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b0fb6-1143-4f90-ba04-3e2f904c94b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:12.803465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b0fb6-1143-4f90-ba04-3e2f904c94b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:12.803808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b0fb6-1143-4f90-ba04-3e2f904c94b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:12.804187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b0fb6-1143-4f90-ba04-3e2f904c94b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:12.815761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b0fb6-1143-4f90-ba04-3e2f904c94b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:12.817162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da50b6fabb9b4f7888b76bcd70fd152e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.817774 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b0fb6-1143-4f90-ba04-3e2f904c94b4 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:12.831830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da50b6fabb9b4f7888b76bcd70fd152e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.832676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da50b6fabb9b4f7888b76bcd70fd152e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.833167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1059/2122] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:12.841229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da50b6fabb9b4f7888b76bcd70fd152e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.865424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da50b6fabb9b4f7888b76bcd70fd152e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:12.875335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1064/2123] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:12 2022] DELETE /identity/v3/users/da50b6fabb9b4f7888b76bcd70fd152e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:12.879652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:12.880487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:12.880487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:12.923458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:12.925623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.021721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1060/2124] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:13.065032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.066573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.129091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed14c-a945-4af1-b867-30dd4335909d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.133187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03258eaf-0849-427b-b8ab-613984638555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.133795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03258eaf-0849-427b-b8ab-613984638555 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.134070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03258eaf-0849-427b-b8ab-613984638555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.134336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03258eaf-0849-427b-b8ab-613984638555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.143720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03258eaf-0849-427b-b8ab-613984638555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.145092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03258eaf-0849-427b-b8ab-613984638555 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.154508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1065/2125] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:13.226047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.227761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.240244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7065573-f615-4986-bd7a-569215b7b9f7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.248327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.249380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.249715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.250085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] PATH_INFO: `/v3/projects/127499906094423fbbe14151cc1e0cf4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.251368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127499906094423fbbe14151cc1e0cf4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.253541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.303653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127499906094423fbbe14151cc1e0cf4', 'request_id': 'req-2312fed0-c86f-40bf-8d41-b4e80e7a5901'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.310665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127499906094423fbbe14151cc1e0cf4', 'request_id': 'req-2312fed0-c86f-40bf-8d41-b4e80e7a5901'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.319762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127499906094423fbbe14151cc1e0cf4', 'request_id': 'req-2312fed0-c86f-40bf-8d41-b4e80e7a5901'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.332195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] The token cache is being invalidate because project 127499906094423fbbe14151cc1e0cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:13.332482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.333460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2312fed0-c86f-40bf-8d41-b4e80e7a5901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.334984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1061/2126] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:13 2022] DELETE /identity/v3/projects/127499906094423fbbe14151cc1e0cf4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:13.340409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.340760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.341138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.377238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:13.378519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.383131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:13.445062 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1066/2127] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:13.453147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.453428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.453699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.475667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:13.476976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.482578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.483921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.490817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1062/2128] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:13.495215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.496325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348e452-ed23-45d1-8e4b-d084ecd630bf None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.505964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff8b2-8a73-4938-866a-8040f05fc325 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.511386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.512143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.512541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.512971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.514141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:13.514499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.516142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.516518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.516941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.517106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.517337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] PATH_INFO: `/v3/projects/71c07dd208654088af88bd8162c43e57` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.518538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c07dd208654088af88bd8162c43e57)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.520326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.532692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1063/2129] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:13.533783 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.543574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146965-0f15-4b23-924b-6577c3dd85da admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.548214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.548825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.549110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.549412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.550016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.551900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.556619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:13.569129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c07dd208654088af88bd8162c43e57', 'request_id': 'req-bfa2c85f-7458-4813-a598-7f6422120e5f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.576242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c07dd208654088af88bd8162c43e57', 'request_id': 'req-bfa2c85f-7458-4813-a598-7f6422120e5f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.581390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1064/2130] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:13 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:13.582239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c07dd208654088af88bd8162c43e57', 'request_id': 'req-bfa2c85f-7458-4813-a598-7f6422120e5f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.585661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.595142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] The token cache is being invalidate because project 71c07dd208654088af88bd8162c43e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:13.595606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.596288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.598123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1067/2131] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:13 2022] DELETE /identity/v3/projects/71c07dd208654088af88bd8162c43e57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:13.602266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.603983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.656079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b3275-e900-4657-976f-f55abd410e9d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.660937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.661554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.661832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.662126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.662806 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.664887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.671743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2c85f-7458-4813-a598-7f6422120e5f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.677212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.677853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.678133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.678442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] PATH_INFO: `/v3/users/c61c814053464814a09d55b1cd96240c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.679690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61c814053464814a09d55b1cd96240c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.681664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.693824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1065/2132] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:13 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:13.698014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.700245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.712828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d28f-93f4-4a76-8675-e0e1f0b3cbab admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.720835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.721801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.722653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.723153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.724352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.726508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.730409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:13.740310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61c814053464814a09d55b1cd96240c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.741747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1066/2133] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:13.742756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.753227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1671a2-1f57-4f50-90cf-d3f06bb053fe admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.755076 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61c814053464814a09d55b1cd96240c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.755787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61c814053464814a09d55b1cd96240c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.756407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61c814053464814a09d55b1cd96240c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.758090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.758728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.758998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.759263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.759959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.761645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.763366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-19ded263-008f-4aa2-920f-94e101510b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61c814053464814a09d55b1cd96240c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:13.772653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1067/2134] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:13.776404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1068/2135] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:13 2022] DELETE /identity/v3/users/c61c814053464814a09d55b1cd96240c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:13.776943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:13.778791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:13.792043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515a3a5-8cbb-45aa-b523-84c147d1e053 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:13.859624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:13.860324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.860602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.860929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] PATH_INFO: `/v3/projects/c13c47aaaf50451e828c157978819954/users/75847f0d3cc341cd8ed599c63a549f25/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.877414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13c47aaaf50451e828c157978819954, user_id=75847f0d3cc341cd8ed599c63a549f25, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:13.879906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:13.894565 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1068/2136] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:13 2022] PUT /identity/v3/projects/c13c47aaaf50451e828c157978819954/users/75847f0d3cc341cd8ed599c63a549f25/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:13.905115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:13.905398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:13.905675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:13.949252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] MFA Rules not processed for user `75847f0d3cc341cd8ed599c63a549f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:13.950597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:14.020063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1069/2137] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:14.031708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.033760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:14.060223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.061688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:14.106100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:14.129993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f0223-178e-41d5-a244-a256e7809fe9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.135278 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e523-6be2-435f-b0dc-bb7bc694c54b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.136134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e523-6be2-435f-b0dc-bb7bc694c54b service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.136417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e523-6be2-435f-b0dc-bb7bc694c54b service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.137174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e523-6be2-435f-b0dc-bb7bc694c54b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.148134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e523-6be2-435f-b0dc-bb7bc694c54b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.149915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e523-6be2-435f-b0dc-bb7bc694c54b service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.152598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a8ee-f35a-400c-bd53-aa757a33998d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.160047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.163089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1069/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:14.172829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.173197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.173477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] PATH_INFO: `/v3/projects/0b67127294c249d58b1a0c5237acd9f4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.176542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b67127294c249d58b1a0c5237acd9f4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.178499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.255075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:14.261430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b67127294c249d58b1a0c5237acd9f4', 'request_id': 'req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:14.271163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b67127294c249d58b1a0c5237acd9f4', 'request_id': 'req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:14.285128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b67127294c249d58b1a0c5237acd9f4', 'request_id': 'req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:14.308876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] The token cache is being invalidate because project 0b67127294c249d58b1a0c5237acd9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:14.309297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:14.310535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-027d4dfd-27a2-4f58-94eb-b16ec3ea4cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:14.313258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1070/2139] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:14 2022] DELETE /identity/v3/projects/0b67127294c249d58b1a0c5237acd9f4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:14.318143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.318599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.319020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.346506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:14.347959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:14.441985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1070/2140] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:14.455026 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.455305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.455572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.485982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:14.488025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:14.498208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1071/2141] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:14.502610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.513143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e8067-0831-4a52-be70-3eb85705fa83 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.518042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.518660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.518937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.519330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.520124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:14.520426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.522163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.539883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1071/2142] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:14.544155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.553302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a67f-8e17-4f01-a0e3-10e9677178c5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.558245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.558849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.559113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.559381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.560021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.561966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.589632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1072/2143] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:14 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:14.593860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.603941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c047d15-1eb1-453c-9bd8-bfaf8ae5c3e6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.663995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.664606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.664606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.665155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.665523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.667638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.700960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1072/2144] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:14 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:14.702286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.714529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe48f5b-9055-4022-84c3-97b07f11440a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.719240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.719846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.720122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.720387 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.721067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.722658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.732792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1073/2145] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:14.736939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.747048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3b20-ffed-4ab6-ae3b-e1f5c68c25cb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.751856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713c81-613b-4b6d-ad2e-c976250e37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.752447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713c81-613b-4b6d-ad2e-c976250e37ae admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.752785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713c81-613b-4b6d-ad2e-c976250e37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.753029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713c81-613b-4b6d-ad2e-c976250e37ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.753745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713c81-613b-4b6d-ad2e-c976250e37ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.755380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713c81-613b-4b6d-ad2e-c976250e37ae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.766084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1073/2146] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:14.770220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:14.780349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d606e-d190-4c34-82e7-170ca2fe2fff admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:14.785557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:14.786208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.786489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.786765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] PATH_INFO: `/v3/projects/e73e3de289a343dfb5868a7f1c81cfb0/users/ca4cea9e855d4fbaa911a127f4b8b837/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.802744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73e3de289a343dfb5868a7f1c81cfb0, user_id=ca4cea9e855d4fbaa911a127f4b8b837, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:14.805531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:14.822772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1074/2147] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:14 2022] PUT /identity/v3/projects/e73e3de289a343dfb5868a7f1c81cfb0/users/ca4cea9e855d4fbaa911a127f4b8b837/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:14.834170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988630-9220-4270-85b5-c7b5c073723b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:14.834455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988630-9220-4270-85b5-c7b5c073723b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:14.834722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20988630-9220-4270-85b5-c7b5c073723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:14.863516 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-20988630-9220-4270-85b5-c7b5c073723b None None] MFA Rules not processed for user `ca4cea9e855d4fbaa911a127f4b8b837`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:14.864711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20988630-9220-4270-85b5-c7b5c073723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:14.898355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:14.935002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1074/2148] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:14.939640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.006892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e1f6-ea1d-4415-96c2-1c20f6cd0abc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.013220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.013898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.014211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.014686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.015803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.017852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.049584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1075/2149] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:14 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:15.055288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20988630-9220-4270-85b5-c7b5c073723b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.066532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20988630-9220-4270-85b5-c7b5c073723b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.132980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.133600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.133895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.134148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.134784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.136714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.160780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1075/2150] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:15 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:15.163037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.173604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7a39-73db-415a-9758-718269c1cd62 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.179242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.179955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.180245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.180508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.181198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.182953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.195765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1076/2151] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:15.199995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.210442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1dae-3c61-495a-9353-25c05905ef71 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.216013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.216669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.216988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.217252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] PATH_INFO: `/v3/projects/7de8d915e224499693bdc895a5686be4/users/032b9594bfad4d6185f060989f0ff697/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.233081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de8d915e224499693bdc895a5686be4, user_id=032b9594bfad4d6185f060989f0ff697, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.236006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.249738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1076/2152] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:15 2022] PUT /identity/v3/projects/7de8d915e224499693bdc895a5686be4/users/032b9594bfad4d6185f060989f0ff697/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:15.253710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.264828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9af6c-183a-40f5-96b8-1070c4705683 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.306504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:15.326277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634afbd-4b17-49de-b1bf-aae5e7fb8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.326923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634afbd-4b17-49de-b1bf-aae5e7fb8dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.327202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634afbd-4b17-49de-b1bf-aae5e7fb8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.327469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634afbd-4b17-49de-b1bf-aae5e7fb8dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.328112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634afbd-4b17-49de-b1bf-aae5e7fb8dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.329762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634afbd-4b17-49de-b1bf-aae5e7fb8dcc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.340217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1077/2153] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:15.344640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.355714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ab012-9d34-45f5-94e5-e2200b372f28 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.361159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.361844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.362122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.362433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] PATH_INFO: `/v3/projects/7de8d915e224499693bdc895a5686be4/users/032b9594bfad4d6185f060989f0ff697/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.364681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de8d915e224499693bdc895a5686be4, user_id=032b9594bfad4d6185f060989f0ff697, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.367755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.379413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1077/2154] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:15 2022] PUT /identity/v3/projects/7de8d915e224499693bdc895a5686be4/users/032b9594bfad4d6185f060989f0ff697/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:15.391086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.391479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.391983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.423990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] MFA Rules not processed for user `032b9594bfad4d6185f060989f0ff697`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:15.425758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:15.509779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1078/2155] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:15.521416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.523157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:15.592952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6c921-66b7-469c-ae11-264c517e269e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.596539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.597737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.598023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.598295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.607823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.609289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.619109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1078/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:15.720132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:15.721640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:15.733888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0a2d2-29af-446f-8285-ecac150c4c14 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:15.738418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8ec8-34da-4296-90a2-b33d6c515a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:15.739052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8ec8-34da-4296-90a2-b33d6c515a50 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:15.739330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8ec8-34da-4296-90a2-b33d6c515a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:15.739604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8ec8-34da-4296-90a2-b33d6c515a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:15.814115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8ec8-34da-4296-90a2-b33d6c515a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:15.815753 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8ec8-34da-4296-90a2-b33d6c515a50 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:15.826336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1079/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:20.370882 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:20.372468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:20.407759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:20.448681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc5ec-76f3-4de4-92fb-ce9cebb226f0 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:20.454114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:20.454755 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:20.455028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:20.455296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] PATH_INFO: `/v3/users/75847f0d3cc341cd8ed599c63a549f25` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:20.456536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75847f0d3cc341cd8ed599c63a549f25)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:20.458604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:20.507395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75847f0d3cc341cd8ed599c63a549f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:20.515128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75847f0d3cc341cd8ed599c63a549f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:20.523120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75847f0d3cc341cd8ed599c63a549f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:20.523766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75847f0d3cc341cd8ed599c63a549f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:20.535690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75847f0d3cc341cd8ed599c63a549f25'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:20.541538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1079/2158] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:20 2022] DELETE /identity/v3/users/75847f0d3cc341cd8ed599c63a549f25 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:20.546434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:20.546821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:20.546821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:20.567641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:20.568849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:20.631778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1080/2159] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:20.641946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:20.643971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:20.706182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e762dea-b051-4f8b-b247-fe17b0adbba9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:20.710394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:20.711021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:20.711292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:20.711557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:20.721925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:20.723356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:20.733097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1080/2160] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:20.972778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:20.974493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:20.985169 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:20.991160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d9834-d0e2-4f32-a417-0a3727d32460 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:20.996578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:20.997432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:20.997849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:20.998218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] PATH_INFO: `/v3/users/ca4cea9e855d4fbaa911a127f4b8b837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:20.999799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4cea9e855d4fbaa911a127f4b8b837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.002103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.080668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4cea9e855d4fbaa911a127f4b8b837'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.096518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4cea9e855d4fbaa911a127f4b8b837'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.097500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4cea9e855d4fbaa911a127f4b8b837'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.098307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4cea9e855d4fbaa911a127f4b8b837'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.107488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-467c671d-7ada-4e4a-a86a-261a9c115fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4cea9e855d4fbaa911a127f4b8b837'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.117715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.119933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.134585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1081/2161] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:20 2022] DELETE /identity/v3/users/ca4cea9e855d4fbaa911a127f4b8b837 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:21.134841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a19a5-6c9e-4609-9a45-0029115b6700 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.136995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.137340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.137956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.163343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:21.164664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.193589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:21.211087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.211788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.212496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.212768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] PATH_INFO: `/v3/projects/c13c47aaaf50451e828c157978819954` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.215038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13c47aaaf50451e828c157978819954)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.218064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.234287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1082/2162] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:21.244301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.246006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.268974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13c47aaaf50451e828c157978819954', 'request_id': 'req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.274537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13c47aaaf50451e828c157978819954', 'request_id': 'req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.283012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13c47aaaf50451e828c157978819954', 'request_id': 'req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.294952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] The token cache is being invalidate because project c13c47aaaf50451e828c157978819954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:21.295348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.296031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ae5c4c32-7bc8-4011-be27-f0856a2a52bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.297601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1081/2163] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:21 2022] DELETE /identity/v3/projects/c13c47aaaf50451e828c157978819954 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:21.304045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4224-7900-46f1-b808-48ad30dea67b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.304418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4224-7900-46f1-b808-48ad30dea67b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.304756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4224-7900-46f1-b808-48ad30dea67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.307353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85b702-dec7-48ef-82aa-903db46703cd None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.326427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8d3e4224-7900-46f1-b808-48ad30dea67b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:21.327482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d3e4224-7900-46f1-b808-48ad30dea67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.348668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:21.395518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.396975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.397261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.397619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.401153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.424851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1082/2164] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:21.430300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.430781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.431219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.451585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:21.452776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.462291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1083/2165] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:21.466607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.476694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe384-06f1-47cc-85b6-a1d846deb48a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.483142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.483829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.484197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.484533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.485286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:21.485650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.487317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.497459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.500134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.501645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1084/2166] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:08:21.505903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.511952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1083/2167] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:21.516226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f59adc-e961-453d-ba16-f6756a2176f2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.521017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.521627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.521922 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.522182 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.522818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.524762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.557433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1085/2168] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:21 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:21.558921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.569088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655052-262f-4dfb-9531-2e5683494566 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.634216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.635149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.635681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.635967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.638264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.638774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.666360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1084/2169] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:21 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:21.667697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.679897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38dcd-e1e3-4c5d-be80-3639aae6570b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.685221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.685917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.686253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.686577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.687295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.688969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.714166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1086/2170] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:21.715568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.726524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4e7f8-d772-4c97-8dfe-7dd41daef93d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.731523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.732146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.732418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.732684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.733393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.735346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.745908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1085/2171] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:21.750589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.761349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd2d2d-1672-4256-b11c-fa929aa67376 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.766059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad13de-b2a2-40c4-a26c-405ea9b979ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.766738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad13de-b2a2-40c4-a26c-405ea9b979ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.767017 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad13de-b2a2-40c4-a26c-405ea9b979ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.767293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad13de-b2a2-40c4-a26c-405ea9b979ce admin admin] PATH_INFO: `/v3/projects/7a3953ba049948969986dd11cd33496f/users/0414977eaec5439e96231bdf7dc5837b/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.784371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad13de-b2a2-40c4-a26c-405ea9b979ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3953ba049948969986dd11cd33496f, user_id=0414977eaec5439e96231bdf7dc5837b, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.788141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad13de-b2a2-40c4-a26c-405ea9b979ce admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.807222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.809347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.810300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1087/2172] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:21 2022] PUT /identity/v3/projects/7a3953ba049948969986dd11cd33496f/users/0414977eaec5439e96231bdf7dc5837b/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:21.815460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.815744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.816155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.825664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85160b-f8d0-425a-a029-549ac8679a44 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:21.828978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:21.843258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:21.845595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.894000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:21.894661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:21.894936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:21.895205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] PATH_INFO: `/v3/projects/e73e3de289a343dfb5868a7f1c81cfb0` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:21.896325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73e3de289a343dfb5868a7f1c81cfb0)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:21.898279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:21.899849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:21.911672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1088/2173] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:21.922154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.923617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.950633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73e3de289a343dfb5868a7f1c81cfb0', 'request_id': 'req-60a2e261-43e1-4acf-8ddc-a90328c04047'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.958771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73e3de289a343dfb5868a7f1c81cfb0', 'request_id': 'req-60a2e261-43e1-4acf-8ddc-a90328c04047'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.964482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73e3de289a343dfb5868a7f1c81cfb0', 'request_id': 'req-60a2e261-43e1-4acf-8ddc-a90328c04047'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.980198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] The token cache is being invalidate because project e73e3de289a343dfb5868a7f1c81cfb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:21.980497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.981144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:21.982648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1086/2174] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:21 2022] DELETE /identity/v3/projects/e73e3de289a343dfb5868a7f1c81cfb0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:21.986638 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:21.987971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:21.991047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74618478-85e9-491e-9da0-a3c5f196233f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:22.043375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:22.043999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:22.044269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:22.044532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:22.046388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:22.056018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2e261-43e1-4acf-8ddc-a90328c04047 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:22.058257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:22.059719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:22.060610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:22.061284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:22.061563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:22.061835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] PATH_INFO: `/v3/users/032b9594bfad4d6185f060989f0ff697` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:22.062975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] RBAC: Authorizing `identity:delete_user(user_id=032b9594bfad4d6185f060989f0ff697)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:22.064980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:22.069143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1089/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:22.116204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032b9594bfad4d6185f060989f0ff697'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.134142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032b9594bfad4d6185f060989f0ff697'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.135160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032b9594bfad4d6185f060989f0ff697'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.136129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032b9594bfad4d6185f060989f0ff697'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.146715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-e50f4c00-6487-4701-a0a6-aebd3190927a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032b9594bfad4d6185f060989f0ff697'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.168931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1087/2176] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:21 2022] DELETE /identity/v3/users/032b9594bfad4d6185f060989f0ff697 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:22.738729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:22.758031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d5fc-99f1-4a2d-b500-b33358edadcd service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:22.830240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:22.830911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:22.831175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:22.831441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] PATH_INFO: `/v3/projects/7de8d915e224499693bdc895a5686be4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:22.832572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de8d915e224499693bdc895a5686be4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:22.834617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:22.841979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:22.892165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de8d915e224499693bdc895a5686be4', 'request_id': 'req-a857f212-f9ff-4317-9aac-b8927576ff48'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.898217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de8d915e224499693bdc895a5686be4', 'request_id': 'req-a857f212-f9ff-4317-9aac-b8927576ff48'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.907469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de8d915e224499693bdc895a5686be4', 'request_id': 'req-a857f212-f9ff-4317-9aac-b8927576ff48'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.920831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] The token cache is being invalidate because project 7de8d915e224499693bdc895a5686be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:22.921134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.921877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a857f212-f9ff-4317-9aac-b8927576ff48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:22.923711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1090/2177] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:22 2022] DELETE /identity/v3/projects/7de8d915e224499693bdc895a5686be4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:22.928602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:22.929147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:22.929249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:22.950524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:22.951830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:22.956836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:23.019499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1088/2178] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:23.027525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.027811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.028087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.049613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:23.050903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:23.059137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1091/2179] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:23.063706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.075680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c686d2-0b48-4407-9f64-dec4412eff0c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.081029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.081694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.081956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.082228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.082908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:23.083204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.084866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.098011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1089/2180] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:08:23.103018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.113375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e5ef-56a1-47cf-9fe5-d9b4b8000aad None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.118484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.119185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.119586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.119793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.120505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.129702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.172175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1092/2181] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:23 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:23.173866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.184958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6d87f-8294-4be6-a777-95a505f9448a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.264536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.265662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.266217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.266545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.267322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.269727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.298763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1090/2182] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:23 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:23.302960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.320687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eda3c-8d06-4915-9faa-068ddc4f8aa4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.330789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.331702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.332177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.332579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.334591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.336320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.349741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1093/2183] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:23.354051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.364875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55657c3-2885-431b-9673-496d7cb9f428 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.370830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdee01-cf46-49d9-a3b6-e9ee046e6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.372486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdee01-cf46-49d9-a3b6-e9ee046e6f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.372486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdee01-cf46-49d9-a3b6-e9ee046e6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.372486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdee01-cf46-49d9-a3b6-e9ee046e6f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.372961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdee01-cf46-49d9-a3b6-e9ee046e6f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.375529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdee01-cf46-49d9-a3b6-e9ee046e6f84 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.387286 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1091/2184] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:23.391681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.407357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49863-e80c-40b5-9265-ae43b7c184a5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.417685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.418509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.419027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.419391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] PATH_INFO: `/v3/projects/5476a3c226d34285a549a57cbe9db464/users/d487600a6ae449b8b403560b3c7fae24/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.438336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5476a3c226d34285a549a57cbe9db464, user_id=d487600a6ae449b8b403560b3c7fae24, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.441724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.458041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1094/2185] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:23 2022] PUT /identity/v3/projects/5476a3c226d34285a549a57cbe9db464/users/d487600a6ae449b8b403560b3c7fae24/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:23.469844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.470399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.470764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.514682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] MFA Rules not processed for user `d487600a6ae449b8b403560b3c7fae24`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:23.516191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:23.641648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1092/2186] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:23.645844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.738515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004369b-b979-4a40-baa6-9a0fe973ec97 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.745877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.746629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.747029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.747354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.749875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.751991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.789717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1095/2187] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:23 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:23.792657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.803175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:23.815658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d4acb-edf7-4801-a98b-bfefc7733ebb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.926928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.927712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.928081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.928443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.929227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.932012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:23.964634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1093/2188] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:23 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:23.968524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:23.980226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b8d08-52ef-4066-880a-bf94d7889a33 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:23.987218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:23.987365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:23.987632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:23.987904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:23.988546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:23.991711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:24.005781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1096/2189] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:24.008036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:24.019401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc10a3-819d-49ae-b3bf-a149897de359 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:24.028587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:24.032383 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:24.034325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:24.034787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] PATH_INFO: `/v3/projects/365fb72d01004d74b1878d2f92b47ab8/users/5f0694c2436c4de9988b0bce40244d6d/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:24.069460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365fb72d01004d74b1878d2f92b47ab8, user_id=5f0694c2436c4de9988b0bce40244d6d, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:24.073544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:24.102031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1094/2190] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:24 2022] PUT /identity/v3/projects/365fb72d01004d74b1878d2f92b47ab8/users/5f0694c2436c4de9988b0bce40244d6d/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:24.106233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:24.113435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:24.120857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1603d6a-84d4-4b4e-90df-c60b110e9d76 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:24.237069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60887b-e778-4ac1-ba11-82215d9af45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:24.237807 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60887b-e778-4ac1-ba11-82215d9af45e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:24.238140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60887b-e778-4ac1-ba11-82215d9af45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:24.238472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60887b-e778-4ac1-ba11-82215d9af45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:24.239583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60887b-e778-4ac1-ba11-82215d9af45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:24.241358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60887b-e778-4ac1-ba11-82215d9af45e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:24.264354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1097/2191] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:24.265718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:24.277473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a87d3-cedb-45e4-8c40-81008503b817 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:24.288437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:24.289228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:24.289578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:24.289950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] PATH_INFO: `/v3/projects/365fb72d01004d74b1878d2f92b47ab8/users/5f0694c2436c4de9988b0bce40244d6d/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:24.293522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365fb72d01004d74b1878d2f92b47ab8, user_id=5f0694c2436c4de9988b0bce40244d6d, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:24.299004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:24.397706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1095/2192] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:24 2022] PUT /identity/v3/projects/365fb72d01004d74b1878d2f92b47ab8/users/5f0694c2436c4de9988b0bce40244d6d/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:24.403211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:24.403597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:24.403976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:24.475250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] MFA Rules not processed for user `5f0694c2436c4de9988b0bce40244d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:24.476915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:24.585193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1098/2193] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:24.642441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:24.643970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:24.719160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fd0fc-41a9-4d14-a9de-267d139a4560 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:24.727382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:24.728602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:24.729025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:24.729353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:24.749463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:24.755320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:24.769965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1096/2194] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:24.874388 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:24.884554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975380a-f9fb-4057-8226-b04bea0079ee None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:24.894953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6a137-5709-466b-9335-f34318e2378d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:24.895686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6a137-5709-466b-9335-f34318e2378d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:24.896057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6a137-5709-466b-9335-f34318e2378d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:24.896399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6a137-5709-466b-9335-f34318e2378d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:24.975137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6a137-5709-466b-9335-f34318e2378d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:24.977293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6a137-5709-466b-9335-f34318e2378d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:24.990425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1099/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:25.353950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:25.424820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554d3dd-2a53-4ca6-8632-bf5151af8cfc service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:25.429895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:25.430585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:25.430862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:25.431134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] PATH_INFO: `/v3/users/d487600a6ae449b8b403560b3c7fae24` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:25.432294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d487600a6ae449b8b403560b3c7fae24)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:25.434328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:25.436071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:25.500247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd487600a6ae449b8b403560b3c7fae24'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:25.519866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd487600a6ae449b8b403560b3c7fae24'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:25.521365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd487600a6ae449b8b403560b3c7fae24'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:25.521851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd487600a6ae449b8b403560b3c7fae24'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:25.530804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd487600a6ae449b8b403560b3c7fae24'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:25.549040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1097/2196] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:25 2022] DELETE /identity/v3/users/d487600a6ae449b8b403560b3c7fae24 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:25.556406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:25.556697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:25.557001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:25.586952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:25.590693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:25.616433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:25.712634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1100/2197] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:25.726979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:25.728518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:25.823573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9229-fa1d-4ba9-a938-e6aefcc7b7a3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:25.827345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:25.828037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:25.828315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:25.828589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:25.846464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:25.848290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:25.863134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1098/2198] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:26.343820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:26.345979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:26.363633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd2eea-e2d0-4bd7-bb86-2992f38578c7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:26.375721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:26.376387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:26.376945 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:26.377299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] PATH_INFO: `/v3/projects/5476a3c226d34285a549a57cbe9db464` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:26.378510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5476a3c226d34285a549a57cbe9db464)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:26.381095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:26.462024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5476a3c226d34285a549a57cbe9db464', 'request_id': 'req-4228970d-43e0-46e4-99eb-a7e2c05703b7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.478226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5476a3c226d34285a549a57cbe9db464', 'request_id': 'req-4228970d-43e0-46e4-99eb-a7e2c05703b7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.491568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5476a3c226d34285a549a57cbe9db464', 'request_id': 'req-4228970d-43e0-46e4-99eb-a7e2c05703b7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.509199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] The token cache is being invalidate because project 5476a3c226d34285a549a57cbe9db464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:26.509599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.510863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.513339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1101/2199] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:26 2022] DELETE /identity/v3/projects/5476a3c226d34285a549a57cbe9db464 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:26.517432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:26.538883 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fb18c-9bce-4f6d-87d0-087a71ce2247 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:26.638359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:26.639661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:26.640178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:26.640660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] PATH_INFO: `/v3/users/5f0694c2436c4de9988b0bce40244d6d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:26.642385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0694c2436c4de9988b0bce40244d6d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:26.644989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:26.678595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:26.724573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0694c2436c4de9988b0bce40244d6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.743798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0694c2436c4de9988b0bce40244d6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.744411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0694c2436c4de9988b0bce40244d6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.745156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0694c2436c4de9988b0bce40244d6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.763230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-84b4bb89-8e05-4c50-9908-27cbd31d34ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0694c2436c4de9988b0bce40244d6d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:26.795793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1099/2200] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:26 2022] DELETE /identity/v3/users/5f0694c2436c4de9988b0bce40244d6d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:27.616786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:27.619339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:27.646343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228970d-43e0-46e4-99eb-a7e2c05703b7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:27.802820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:27.803590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:27.803934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:27.804295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] PATH_INFO: `/v3/projects/365fb72d01004d74b1878d2f92b47ab8` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:27.805769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365fb72d01004d74b1878d2f92b47ab8)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:27.807818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:27.902374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365fb72d01004d74b1878d2f92b47ab8', 'request_id': 'req-97b5a66e-c4e9-40f1-9955-5c1539839684'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:27.907393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:27.916510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365fb72d01004d74b1878d2f92b47ab8', 'request_id': 'req-97b5a66e-c4e9-40f1-9955-5c1539839684'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:27.928667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365fb72d01004d74b1878d2f92b47ab8', 'request_id': 'req-97b5a66e-c4e9-40f1-9955-5c1539839684'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:27.947094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] The token cache is being invalidate because project 365fb72d01004d74b1878d2f92b47ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:27.948053 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:27.948545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-97b5a66e-c4e9-40f1-9955-5c1539839684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:27.954366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1102/2201] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:27 2022] DELETE /identity/v3/projects/365fb72d01004d74b1878d2f92b47ab8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:27.955355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0e54-d456-4868-9250-9d9a51a26029 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:27.957352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0e54-d456-4868-9250-9d9a51a26029 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:27.957842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0e54-d456-4868-9250-9d9a51a26029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:27.987408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-eedf0e54-d456-4868-9250-9d9a51a26029 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:27.988877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eedf0e54-d456-4868-9250-9d9a51a26029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.013117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.013678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.014303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.053196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] MFA Rules not processed for user `0414977eaec5439e96231bdf7dc5837b`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:28.054596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.135804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1100/2202] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:28.143476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1103/2203] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:28.146419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.147053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.147461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.148095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.150023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.166984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a54956-299c-4e97-bf1c-9e089a8ebec0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.172435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.173100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.173530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.173926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.176386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.178343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.179946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:28.181357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.195055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1101/2204] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:28.196689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.207312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c549-fe16-47d3-9719-64c1aae3a003 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.212528 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.213464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.213901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.214024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1104/2205] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:28.214453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.215165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:28.215475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.217475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.218097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.234441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1102/2206] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:28.235595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.251313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8d31d-ff46-420f-bfea-60b9ff563314 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.299874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da09233-07c6-4096-889a-dc1c08ba29b8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.305984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.307190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.307539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.307900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.308880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.314422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.332018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.333102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.333494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.333879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.334689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.336758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.337596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1105/2207] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:28.341829 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.359889 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba6bfd-bdaf-4a0c-9fa9-161234b17205 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.365550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.366253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.366619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.367177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.367947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.369687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.375687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1103/2208] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:28.377522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.382756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1106/2209] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:28.386918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.397640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:28.408030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65146291-f747-4914-91b1-6178b1c50ff0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.451855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:28.496752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ed715-79d4-4d2f-8d48-338213b6ce08 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.503009 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.503627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.503914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.504187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.504881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.506792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.525851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.526505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.526950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.527069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] PATH_INFO: `/v3/projects/6bf6a075673443b685e6ea043376dff6/users/d1d2f2f87e594a64acc664444fe4ea14/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.533927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1104/2210] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:28.534747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.538290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.546292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf6a075673443b685e6ea043376dff6, user_id=d1d2f2f87e594a64acc664444fe4ea14, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.549048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.550879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3bf0-250a-4d56-b2e7-759b528a23ee admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.556575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.557395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.557698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.558127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] PATH_INFO: `/v3/users/18a47580984245ac81f533b36409ebec` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.559337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a47580984245ac81f533b36409ebec)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.561351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.564620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1107/2211] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:28 2022] PUT /identity/v3/projects/6bf6a075673443b685e6ea043376dff6/users/d1d2f2f87e594a64acc664444fe4ea14/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:28.568480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.617115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a47580984245ac81f533b36409ebec'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:28.631194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a47580984245ac81f533b36409ebec'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:28.631975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a47580984245ac81f533b36409ebec'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:28.632595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a47580984245ac81f533b36409ebec'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:28.640354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a47580984245ac81f533b36409ebec'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:28.641124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77911bb6-0a3a-4d4a-b9d2-b6edc88dd757 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.647653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.648600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.648888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.649494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.650162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.651943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.656605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1105/2212] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:28 2022] DELETE /identity/v3/users/18a47580984245ac81f533b36409ebec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:28.657344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.658811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.665742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1108/2213] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:28.669506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.671304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.686488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117a43-381d-4c4c-bdd9-d86897e3a6b0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.760419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf945a6-c1aa-4c7d-8cf7-b8b8dbd61b3f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.766519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.767349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.767727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.768102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.769016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.770960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.778214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.778838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.779113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.779380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.780424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.782145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.793246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1109/2214] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:28.797027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1106/2215] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:28.797803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.802631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.811551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0850a6e-4d41-431a-830e-321083784954 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.816182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:28.825266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d601f3-2005-4b72-a94c-f7e9ec09b01c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:28.827041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.827911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.828920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.829366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] PATH_INFO: `/v3/projects/103bbce06f0c4d65b8598ec30e2c34a2/users/b6bdb2bb94c44e2fbaa75b677a83df9c/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.836280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967b87d-4b98-4732-96f7-0f7b32fee5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:28.836920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b87d-4b98-4732-96f7-0f7b32fee5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.837205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b87d-4b98-4732-96f7-0f7b32fee5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.837477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967b87d-4b98-4732-96f7-0f7b32fee5bb admin admin] PATH_INFO: `/v3/projects/6bf6a075673443b685e6ea043376dff6/users/d1d2f2f87e594a64acc664444fe4ea14/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.843588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b87d-4b98-4732-96f7-0f7b32fee5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf6a075673443b685e6ea043376dff6, user_id=d1d2f2f87e594a64acc664444fe4ea14, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.846306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967b87d-4b98-4732-96f7-0f7b32fee5bb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.850519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] RBAC: Authorizing `identity:create_grant(project_id=103bbce06f0c4d65b8598ec30e2c34a2, user_id=b6bdb2bb94c44e2fbaa75b677a83df9c, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:28.854540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:28.873145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1107/2216] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:28 2022] PUT /identity/v3/projects/6bf6a075673443b685e6ea043376dff6/users/d1d2f2f87e594a64acc664444fe4ea14/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:28.885408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1110/2217] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:28 2022] PUT /identity/v3/projects/103bbce06f0c4d65b8598ec30e2c34a2/users/b6bdb2bb94c44e2fbaa75b677a83df9c/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:28.896057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:28.896449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:28.896767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:28.936129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:28.938625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.955601 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] MFA Rules not processed for user `b6bdb2bb94c44e2fbaa75b677a83df9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:28.956868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:28.974771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:29.056707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216989b-ece6-4b05-b071-55884525939e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:29.067325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:29.067988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:29.068258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:29.068699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] PATH_INFO: `/v3/projects/018bc3de9eca4ccab0da488dacf32f3a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:29.069983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018bc3de9eca4ccab0da488dacf32f3a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:29.071946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:29.134476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1108/2218] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:29.151879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:29.154945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.158424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018bc3de9eca4ccab0da488dacf32f3a', 'request_id': 'req-055e9e85-079f-4f80-8876-53432683c9b8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.164612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018bc3de9eca4ccab0da488dacf32f3a', 'request_id': 'req-055e9e85-079f-4f80-8876-53432683c9b8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.176508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018bc3de9eca4ccab0da488dacf32f3a', 'request_id': 'req-055e9e85-079f-4f80-8876-53432683c9b8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.188979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] The token cache is being invalidate because project 018bc3de9eca4ccab0da488dacf32f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:29.189272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.189860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.194676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1111/2219] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:28 2022] DELETE /identity/v3/projects/018bc3de9eca4ccab0da488dacf32f3a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:29.196618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:29.197921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.232415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a780ce-b704-42d0-97b8-fd43ef58f18a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:29.304139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e9e85-079f-4f80-8876-53432683c9b8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:29.306198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:29.306908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:29.307302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:29.307686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:29.310012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.312928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:29.314135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:29.314674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:29.315148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] PATH_INFO: `/v3/users/5269ae85f9b34930b06a47e095d62d34` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:29.317327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5269ae85f9b34930b06a47e095d62d34)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:29.319988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:29.398597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:29.398936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5269ae85f9b34930b06a47e095d62d34'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.401701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:29.413822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5269ae85f9b34930b06a47e095d62d34'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.420133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:29.424965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:29.426905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5269ae85f9b34930b06a47e095d62d34'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.427880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5269ae85f9b34930b06a47e095d62d34'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.445935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5269ae85f9b34930b06a47e095d62d34'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.450571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1109/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:29.461110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1112/2221] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:29 2022] DELETE /identity/v3/users/5269ae85f9b34930b06a47e095d62d34 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:29.476550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:29.478994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.499341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722698f-b32a-458e-a796-7be083276188 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:29.590729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:29.591633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:29.592104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:29.592385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] PATH_INFO: `/v3/users/b6bdb2bb94c44e2fbaa75b677a83df9c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:29.593617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bdb2bb94c44e2fbaa75b677a83df9c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:29.595690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:29.663340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bdb2bb94c44e2fbaa75b677a83df9c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.682424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bdb2bb94c44e2fbaa75b677a83df9c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.683475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bdb2bb94c44e2fbaa75b677a83df9c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.684145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bdb2bb94c44e2fbaa75b677a83df9c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.692436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5493d870-b61e-4773-835b-987aa8a0c7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bdb2bb94c44e2fbaa75b677a83df9c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.719458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:29.721642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.723900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1110/2222] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:29 2022] DELETE /identity/v3/users/b6bdb2bb94c44e2fbaa75b677a83df9c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:29.730096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:29.730771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:29.731274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:29.742744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e9e35-495b-4313-af42-a3aea29e6a87 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:29.771071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:29.772547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.838909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1111/2223] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:29.847331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:29.849874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:29.850402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:29.850908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] PATH_INFO: `/v3/projects/2d2c5a7eded14a06b39988997a53e826` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:29.851208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:29.853766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2c5a7eded14a06b39988997a53e826)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:29.854475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:29.857538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:29.875016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:29.951327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2c5a7eded14a06b39988997a53e826', 'request_id': 'req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.962690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2c5a7eded14a06b39988997a53e826', 'request_id': 'req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.970533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b759918-3abb-404f-87ae-d2575036ad02 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:29.972848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2c5a7eded14a06b39988997a53e826', 'request_id': 'req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.989888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] The token cache is being invalidate because project 2d2c5a7eded14a06b39988997a53e826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:29.991435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.992294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b7ef6c4-d1a2-417d-aa19-4de3af3bb3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:29.994467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1113/2224] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:29 2022] DELETE /identity/v3/projects/2d2c5a7eded14a06b39988997a53e826 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:30.001064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bb175-7482-4c94-9a0b-586ff35419d6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.001608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bb175-7482-4c94-9a0b-586ff35419d6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.002006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bb175-7482-4c94-9a0b-586ff35419d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.032528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cb5bb175-7482-4c94-9a0b-586ff35419d6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:30.035117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cb5bb175-7482-4c94-9a0b-586ff35419d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:30.103900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.106022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.106476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.106927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.114543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:30.246549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:30.282729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1114/2225] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:30.289293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.289870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.290367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.311390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.313241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.325203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1112/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:30.335534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:30.338062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:30.353279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1115/2227] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:30.357821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.370020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f76918-60b7-4710-9fca-fb02dae77310 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:30.375985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.377493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.378902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.379381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.380242 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:30.381257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.383027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.402444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.403704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1113/2228] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:30.413833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67297167-d619-44f4-b823-fb4858d770b5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:30.418995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.419599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.419854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.420120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.420785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.422732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.480273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1116/2229] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:30 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:30.484218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.495961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717984-2dc0-47d7-ba76-f2770762f525 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:30.574694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.575324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.575600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.575869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.576526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.578637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.592085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:30.612014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1114/2230] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:30 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:30.613103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.626284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980b047-0b63-4bf5-aed7-061ae6a4fe46 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:30.632598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.633705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.634207 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.634776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.635949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.638610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.658024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1117/2231] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:30.658766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.670522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ea284-3c51-4470-80a0-96c584dde501 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:30.675800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211844b-f406-4233-85ea-ad7c5b68cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.676630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211844b-f406-4233-85ea-ad7c5b68cd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.676942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211844b-f406-4233-85ea-ad7c5b68cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.677213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211844b-f406-4233-85ea-ad7c5b68cd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.678015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211844b-f406-4233-85ea-ad7c5b68cd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.679801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211844b-f406-4233-85ea-ad7c5b68cd4b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.697743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1115/2232] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:30.699088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.712764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26744e40-5c9e-4b65-a21c-7acb5ad0fb65 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:30.722452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:30.723162 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.723911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.724370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] PATH_INFO: `/v3/projects/9b7c69b4ec5b4de9830e410a28b14a05/users/fe910ebfd9404157ba77f2220082fa28/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.746732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7c69b4ec5b4de9830e410a28b14a05, user_id=fe910ebfd9404157ba77f2220082fa28, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:30.750445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:30.768415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1118/2233] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:30 2022] PUT /identity/v3/projects/9b7c69b4ec5b4de9830e410a28b14a05/users/fe910ebfd9404157ba77f2220082fa28/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:30.779727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:30.780065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:30.780339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:30.815634 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] MFA Rules not processed for user `fe910ebfd9404157ba77f2220082fa28`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:30.817814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:30.898000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1116/2234] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:30.902794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:30.994020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b39224-82c9-4982-ae0a-8866000fc045 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.024267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.025283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.026472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.028849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.029681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.035078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.100164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1119/2235] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:30 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:31.104499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.116929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8821-e588-4e5b-b2cc-7bd188b0431d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.196070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.196708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.197007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.197276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.197921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.202568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.269095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1117/2236] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:31 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:31.269391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.283297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.291706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:31.294529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa2861-84f9-4fb7-bffe-451ebb5bddda admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.301412 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.302917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.305620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.305990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.306953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.308856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099f095-b04f-4978-aa75-afd9ec61c9f5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.311633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.324585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.325295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.325570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.325840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] PATH_INFO: `/v3/projects/103bbce06f0c4d65b8598ec30e2c34a2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.327533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103bbce06f0c4d65b8598ec30e2c34a2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.330418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.339302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1120/2237] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:31.347135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.410201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4eb73-ac1e-4c1a-8d42-cfd9e584eea0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.430364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103bbce06f0c4d65b8598ec30e2c34a2', 'request_id': 'req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:31.440327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103bbce06f0c4d65b8598ec30e2c34a2', 'request_id': 'req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:31.443412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:31.453901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103bbce06f0c4d65b8598ec30e2c34a2', 'request_id': 'req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:31.480894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] The token cache is being invalidate because project 103bbce06f0c4d65b8598ec30e2c34a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:31.481135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:31.481776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-139bf0e4-1404-4a93-a47c-9803bcf1a0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:31.484566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1118/2238] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:31 2022] DELETE /identity/v3/projects/103bbce06f0c4d65b8598ec30e2c34a2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:31.490558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d60d-2048-447c-99aa-f17373589717 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.491260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d60d-2048-447c-99aa-f17373589717 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.491716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d60d-2048-447c-99aa-f17373589717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.523553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e257d60d-2048-447c-99aa-f17373589717 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:31.528698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e257d60d-2048-447c-99aa-f17373589717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:31.591640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.592832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.593337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.593852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.595025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.597158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.609281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1121/2239] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:31.613589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.616505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:31.627092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:31.635125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46263e23-6483-4583-8894-ee8c351cb8d0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.657591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f57798-4709-437e-a73b-4498c0dd1b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.658359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57798-4709-437e-a73b-4498c0dd1b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.658888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1119/2240] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:31.661111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57798-4709-437e-a73b-4498c0dd1b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.662205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57798-4709-437e-a73b-4498c0dd1b66 admin admin] PATH_INFO: `/v3/projects/6a35ce6f870243f9a228a2ebc654fa66/users/e7993d85e8d64bf8b331c0190e7e545d/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.678111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.678410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.678687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.727104 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f57798-4709-437e-a73b-4498c0dd1b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a35ce6f870243f9a228a2ebc654fa66, user_id=e7993d85e8d64bf8b331c0190e7e545d, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.731171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f57798-4709-437e-a73b-4498c0dd1b66 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.732668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:31.735657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:31.785524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1120/2241] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:31.795475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.807995 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1122/2242] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:31 2022] PUT /identity/v3/projects/6a35ce6f870243f9a228a2ebc654fa66/users/e7993d85e8d64bf8b331c0190e7e545d/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:31.818235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e6ac-c514-48b1-a246-0d53745c8924 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.819001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.819288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.819582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.855733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] MFA Rules not processed for user `e7993d85e8d64bf8b331c0190e7e545d`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:31.859666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:31.897779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.898423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.898697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.899085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.899752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:31.900147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.902733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.918983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1121/2243] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:31.924388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.934620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43e2f-9a83-4e8f-b711-61686b8d5a90 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.946906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.947536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.947813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.948083 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.948724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.950676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:31.955515 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1123/2244] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:31.960035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:31.987136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbee4b4-a87d-4c5e-95e1-574faf1bd486 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:31.993628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:31.994584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:31.995095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:31.995437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:31.996203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:31.998906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.003130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1122/2245] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:31 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:32.012148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.046842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1124/2246] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:31 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:32.052179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.086650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:32.115650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6dd41-3842-41a0-8f2b-11e44f210275 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.168962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a165dd7-359b-4e6a-96b0-8c951458f893 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.174335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.175085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.175366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.175636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.176394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.179311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.222169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1125/2247] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:32 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:32.223472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.235302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a759-56c7-4084-a300-a8124f34243b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.241915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.242628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.242916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.243233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.244361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.246583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.248222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.249271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.249547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.249815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.250631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.252625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.263154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1126/2248] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:32.264887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.280932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af810039-0743-4622-8ba1-b14a29218800 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.282819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1123/2249] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:32 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:32.286634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.287334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.287603 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.287981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.288348 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] PATH_INFO: `/v3/projects/d5eedf2d57b643b28287e7eaf0e2917f/users/c3eee372f86947c899fafd2ec74b00fa/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.299245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701da9a4-3080-44b5-bb76-a49ab5c3c89a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.306045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.307098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.307519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.307632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5eedf2d57b643b28287e7eaf0e2917f, user_id=c3eee372f86947c899fafd2ec74b00fa, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.308025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.308886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.310675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.310891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.327211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1124/2250] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:32.327905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:32.331198 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.334000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1127/2251] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:32 2022] PUT /identity/v3/projects/d5eedf2d57b643b28287e7eaf0e2917f/users/c3eee372f86947c899fafd2ec74b00fa/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:32.339390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.349269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba019d9-d886-4f1e-be2e-0118ad389cf4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.428787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.430431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.430780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.431061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.431733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.433547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.443376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5e1ab-70a5-44e3-b454-c65188954f0e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.450070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.450413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.451018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.451504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.452285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.454056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.467624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1128/2252] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:32.479540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1125/2253] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:32.488542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.490375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.506416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabfeee-53c5-406e-83b3-1d10d4d89cae admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.511802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06197e5f-eb6f-4d10-b73d-00e37cad7c8c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.519329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93970d-1b5d-4411-961c-42a41cb3806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.520313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93970d-1b5d-4411-961c-42a41cb3806a admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.520714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93970d-1b5d-4411-961c-42a41cb3806a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.521110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93970d-1b5d-4411-961c-42a41cb3806a admin admin] PATH_INFO: `/v3/projects/2fdd76f7adbd45b996bdee0f197a2691/users/d180fe83e8974fb79fc1d4ee31b2d630/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.522302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6049521-f037-4cd9-81bc-d71153589b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.523123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6049521-f037-4cd9-81bc-d71153589b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.523411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6049521-f037-4cd9-81bc-d71153589b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.523684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6049521-f037-4cd9-81bc-d71153589b05 admin admin] PATH_INFO: `/v3/projects/d5eedf2d57b643b28287e7eaf0e2917f/users/c3eee372f86947c899fafd2ec74b00fa/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.525907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6049521-f037-4cd9-81bc-d71153589b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5eedf2d57b643b28287e7eaf0e2917f, user_id=c3eee372f86947c899fafd2ec74b00fa, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.528658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6049521-f037-4cd9-81bc-d71153589b05 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.546870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1129/2254] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:32 2022] PUT /identity/v3/projects/d5eedf2d57b643b28287e7eaf0e2917f/users/c3eee372f86947c899fafd2ec74b00fa/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:32.558304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.558578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.558847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.567731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93970d-1b5d-4411-961c-42a41cb3806a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdd76f7adbd45b996bdee0f197a2691, user_id=d180fe83e8974fb79fc1d4ee31b2d630, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:32.571874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93970d-1b5d-4411-961c-42a41cb3806a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:32.592548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1126/2255] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:32 2022] PUT /identity/v3/projects/2fdd76f7adbd45b996bdee0f197a2691/users/d180fe83e8974fb79fc1d4ee31b2d630/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:32.597721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.598074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.598688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.618624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] MFA Rules not processed for user `c3eee372f86947c899fafd2ec74b00fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:32.622989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:32.630746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:32.632247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:32.737919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:32.784608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1130/2256] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:32.797090 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.799463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:32.802598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1127/2257] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:32.804113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:32.805716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:32.949858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae6232-52f4-4ad6-9e85-5b60a3899c15 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.965394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab655b11-7825-4eec-8e0c-08295769864a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:32.969568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.970854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.972604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.973566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.977069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d42c-6851-48f2-8d56-b22799fba4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:32.978655 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d42c-6851-48f2-8d56-b22799fba4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:32.978872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d42c-6851-48f2-8d56-b22799fba4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:32.979121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d42c-6851-48f2-8d56-b22799fba4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:32.983802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:33.026290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d42c-6851-48f2-8d56-b22799fba4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:33.027864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d42c-6851-48f2-8d56-b22799fba4a4 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:33.044554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1128/2258] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:33.056759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:33.141472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:33.145262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:33.172922 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1131/2259] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:34.508042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:34.509101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:34.509581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:34.544180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] MFA Rules not processed for user `d180fe83e8974fb79fc1d4ee31b2d630`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:34.546806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:34.662904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1129/2260] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:34.672780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:34.682530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de785baa-77ee-4823-a280-6f79ebac00fd service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:34.686246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0c5cf-0126-416e-b515-f463bed82107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:34.686891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0c5cf-0126-416e-b515-f463bed82107 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:34.687344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0c5cf-0126-416e-b515-f463bed82107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:34.687626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0c5cf-0126-416e-b515-f463bed82107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:34.740446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0c5cf-0126-416e-b515-f463bed82107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:34.748689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0c5cf-0126-416e-b515-f463bed82107 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:34.788347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1132/2261] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:35.490140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:35.507805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002086e-0df4-460e-9e9b-f02f948fe1ac None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:35.513431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:35.514034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:35.514034 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:35.514320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:35.585574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:35.588326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:35.618551 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1130/2262] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:35.624413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40a90-fa03-4af7-ab87-fa992acc343e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:35.624690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40a90-fa03-4af7-ab87-fa992acc343e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:35.624991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40a90-fa03-4af7-ab87-fa992acc343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:35.658962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d1a40a90-fa03-4af7-ab87-fa992acc343e None None] MFA Rules not processed for user `d1d2f2f87e594a64acc664444fe4ea14`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:35.660313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d1a40a90-fa03-4af7-ab87-fa992acc343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:35.739985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1133/2263] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:35.755541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:35.757436 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:35.785914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:35.836708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4c2b-12b9-4823-9ca6-3a855e6dcd98 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:35.841744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:35.842595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:35.842872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:35.843305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:35.845754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:35.924473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:35.925956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:35.938283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1131/2264] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:36.157810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:36.158096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:36.158575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:36.183625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:36.184903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:36.267966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1134/2265] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:36.347161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:36.349467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:36.463249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7233d-6a4a-481b-a488-abccbde36d58 service glance] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:36.472729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:36.474751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:36.477633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e936cf5-a6c8-473f-b0e3-a90f4fe9d55d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:36.480236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936cf5-a6c8-473f-b0e3-a90f4fe9d55d service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:36.480517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936cf5-a6c8-473f-b0e3-a90f4fe9d55d service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:36.480878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936cf5-a6c8-473f-b0e3-a90f4fe9d55d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:36.491495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675bd9-d2e1-4038-9348-7d54fc0df30e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:36.495898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:36.496772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:36.497223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:36.497667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:36.504432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e936cf5-a6c8-473f-b0e3-a90f4fe9d55d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:36.506616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e936cf5-a6c8-473f-b0e3-a90f4fe9d55d service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:36.517418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1132/2266] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:08:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:08:36.518746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a2342-d2c3-44c5-97ee-93b2a9e2568b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:36.518995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a2342-d2c3-44c5-97ee-93b2a9e2568b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:36.519308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a2342-d2c3-44c5-97ee-93b2a9e2568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:36.524876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:36.526970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:36.540075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-482a2342-d2c3-44c5-97ee-93b2a9e2568b None None] MFA Rules not processed for user `d180fe83e8974fb79fc1d4ee31b2d630`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:36.541492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1135/2267] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:36.545012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-482a2342-d2c3-44c5-97ee-93b2a9e2568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:36.555358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1133/2268] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:41.202938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:41.221217 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ddfc-ef7e-4456-be27-354ed21ecb3e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:41.228934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:41.231127 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:41.231883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:41.232528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] PATH_INFO: `/v3/users/fe910ebfd9404157ba77f2220082fa28` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:41.237256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe910ebfd9404157ba77f2220082fa28)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:41.239431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:41.304351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:41.375892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe910ebfd9404157ba77f2220082fa28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:41.408230 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe910ebfd9404157ba77f2220082fa28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:41.440586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe910ebfd9404157ba77f2220082fa28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:41.443965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe910ebfd9404157ba77f2220082fa28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:41.480277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe910ebfd9404157ba77f2220082fa28'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:41.494072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1136/2269] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:41 2022] DELETE /identity/v3/users/fe910ebfd9404157ba77f2220082fa28 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:41.511332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:41.512321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:41.512749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:41.546823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:41.548437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:41.619664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:41.632778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1134/2270] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:41.645424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:41.649833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:41.770294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b469a4-d25c-4500-beaf-954786ca2c44 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:41.774778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:41.775523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:41.775887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:41.776239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:41.793833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:41.802125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:41.823190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1137/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:08:42.252321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:42.256033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:42.275795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538faa-3bc0-430b-a281-0937c3944cbb None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:42.287751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:42.288404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:42.288670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:42.288964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] PATH_INFO: `/v3/projects/9b7c69b4ec5b4de9830e410a28b14a05` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:42.292441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7c69b4ec5b4de9830e410a28b14a05)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:42.303071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:42.405317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7c69b4ec5b4de9830e410a28b14a05', 'request_id': 'req-354f0b66-23e2-40e9-a407-b083a3cd9654'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.413110 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7c69b4ec5b4de9830e410a28b14a05', 'request_id': 'req-354f0b66-23e2-40e9-a407-b083a3cd9654'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.421700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7c69b4ec5b4de9830e410a28b14a05', 'request_id': 'req-354f0b66-23e2-40e9-a407-b083a3cd9654'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.443854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] The token cache is being invalidate because project 9b7c69b4ec5b4de9830e410a28b14a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:42.444434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.446756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.452768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1135/2272] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:42 2022] DELETE /identity/v3/projects/9b7c69b4ec5b4de9830e410a28b14a05 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:42.456382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:42.473593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280e08-4e06-42c7-a193-fd45effe683e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:42.550904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:42.551568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:42.551839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:42.552106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] PATH_INFO: `/v3/users/e7993d85e8d64bf8b331c0190e7e545d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:42.553434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7993d85e8d64bf8b331c0190e7e545d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:42.555822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:42.619087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:42.620607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:42.633689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:42.639626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7993d85e8d64bf8b331c0190e7e545d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.645168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f0b66-23e2-40e9-a407-b083a3cd9654 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:42.658395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7993d85e8d64bf8b331c0190e7e545d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.663803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:42.664374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:42.664647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:42.664942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] PATH_INFO: `/v3/users/c17d9157502a418b80196e146493e02f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:42.667860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17d9157502a418b80196e146493e02f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:42.669876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:42.682223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7993d85e8d64bf8b331c0190e7e545d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.683070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7993d85e8d64bf8b331c0190e7e545d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.713663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd39f1d0-f5f4-4c7a-8017-bf3a8b808d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7993d85e8d64bf8b331c0190e7e545d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.726790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1138/2273] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:42 2022] DELETE /identity/v3/users/e7993d85e8d64bf8b331c0190e7e545d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:42.790472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17d9157502a418b80196e146493e02f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.816219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17d9157502a418b80196e146493e02f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.817145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17d9157502a418b80196e146493e02f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.817909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17d9157502a418b80196e146493e02f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.837926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17d9157502a418b80196e146493e02f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:42.864750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1136/2274] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:42 2022] DELETE /identity/v3/users/c17d9157502a418b80196e146493e02f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:08:42.869609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:42.869887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:42.870245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:42.899579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:42.901177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:43.046087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1139/2275] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:43.072851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:43.074591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:43.285055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:43.287580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:43.298962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de9508-b985-45ce-aa79-ff5b6e4cee86 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:43.307373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:43.308014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:43.309394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:43.309681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:43.311311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4f4b-f00d-4c01-81b1-168e0e6d2f37 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:43.335878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:43.337305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:43.337811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:43.338338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] PATH_INFO: `/v3/projects/6a35ce6f870243f9a228a2ebc654fa66` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:43.341080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a35ce6f870243f9a228a2ebc654fa66)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:43.345231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:43.350818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:43.351583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:43.353416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:43.407375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1137/2276] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:43.422832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a35ce6f870243f9a228a2ebc654fa66', 'request_id': 'req-985fe092-262b-44c3-b38a-a2bb86c19457'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.429179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a35ce6f870243f9a228a2ebc654fa66', 'request_id': 'req-985fe092-262b-44c3-b38a-a2bb86c19457'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.462020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a35ce6f870243f9a228a2ebc654fa66', 'request_id': 'req-985fe092-262b-44c3-b38a-a2bb86c19457'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.491097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] The token cache is being invalidate because project 6a35ce6f870243f9a228a2ebc654fa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:43.493065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.494793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.497695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1140/2277] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:43 2022] DELETE /identity/v3/projects/6a35ce6f870243f9a228a2ebc654fa66 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:43.501779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:43.512432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4af90e-4e98-48c9-8c21-dc2c1ba2ff68 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:43.628029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:43.629682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:43.630353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:43.630790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] PATH_INFO: `/v3/users/c3eee372f86947c899fafd2ec74b00fa` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:43.632234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3eee372f86947c899fafd2ec74b00fa)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:43.635577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:43.762987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3eee372f86947c899fafd2ec74b00fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.793834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3eee372f86947c899fafd2ec74b00fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.794778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3eee372f86947c899fafd2ec74b00fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.795492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3eee372f86947c899fafd2ec74b00fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.825384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-3b5e2b8e-fd77-4c7c-b721-2ad4402cf955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3eee372f86947c899fafd2ec74b00fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:43.858738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1138/2278] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:43 2022] DELETE /identity/v3/users/c3eee372f86947c899fafd2ec74b00fa => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:44.090439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:44.092333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.116092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fe092-262b-44c3-b38a-a2bb86c19457 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:44.237907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:44.262816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:44.263513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.263790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.264060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] PATH_INFO: `/v3/projects/a292d8d312894aa0a52715abce9746bc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.265282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a292d8d312894aa0a52715abce9746bc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:44.267213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:44.343042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a292d8d312894aa0a52715abce9746bc', 'request_id': 'req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.350423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a292d8d312894aa0a52715abce9746bc', 'request_id': 'req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.360490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a292d8d312894aa0a52715abce9746bc', 'request_id': 'req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.377477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] The token cache is being invalidate because project a292d8d312894aa0a52715abce9746bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:44.377877 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.378558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.381300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1141/2279] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:44 2022] DELETE /identity/v3/projects/a292d8d312894aa0a52715abce9746bc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:44.386385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ebf6-da76-4d8f-8e86-43c66a86d0c8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.387025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ebf6-da76-4d8f-8e86-43c66a86d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.387370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166ebf6-da76-4d8f-8e86-43c66a86d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.412143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:44.416739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.426160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6166ebf6-da76-4d8f-8e86-43c66a86d0c8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:44.428852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6166ebf6-da76-4d8f-8e86-43c66a86d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.525685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acd6b-d93f-4e3f-a381-eb26b91a48a7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:44.536954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:44.537834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.538476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.538916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] PATH_INFO: `/v3/projects/d5eedf2d57b643b28287e7eaf0e2917f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.540291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5eedf2d57b643b28287e7eaf0e2917f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:44.542605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:44.553229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1139/2280] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:44.562360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.562652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.562924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.594070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:44.595280 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.608842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1140/2281] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:44.612259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:44.629414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bab54-9ad8-4854-91d8-9f180209e4a5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:44.638661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:44.644767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5eedf2d57b643b28287e7eaf0e2917f', 'request_id': 'req-408e93e7-c28e-47da-8167-edf5a26c6d9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.659374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5eedf2d57b643b28287e7eaf0e2917f', 'request_id': 'req-408e93e7-c28e-47da-8167-edf5a26c6d9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.674640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5eedf2d57b643b28287e7eaf0e2917f', 'request_id': 'req-408e93e7-c28e-47da-8167-edf5a26c6d9e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.698307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] The token cache is being invalidate because project d5eedf2d57b643b28287e7eaf0e2917f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:08:44.698540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.699331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-408e93e7-c28e-47da-8167-edf5a26c6d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:44.705360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1142/2282] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:44 2022] DELETE /identity/v3/projects/d5eedf2d57b643b28287e7eaf0e2917f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:44.707461 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66a64-f6f8-4470-b03e-090ae393b2ab None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.707847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66a64-f6f8-4470-b03e-090ae393b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.708222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c66a64-f6f8-4470-b03e-090ae393b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.718863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:44.731022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d5c66a64-f6f8-4470-b03e-090ae393b2ab None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:44.735519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d5c66a64-f6f8-4470-b03e-090ae393b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.752776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:44.753446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.753727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.754003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.754810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:44.755116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:44.756780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:44.791681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1141/2283] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:08:44.792815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:44.794936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.817822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9bbca-266c-4975-ba7b-3fbfce4ddd7d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:44.829984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1143/2284] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:44.837757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.838273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.838809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.840649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:44.841537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:44.841971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:44.842397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:44.843211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:44.847709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:44.886611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:44.887980 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:44.905745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1144/2285] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:08:44.907807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1142/2286] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:44 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:44.911834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:44.912100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:44.923741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25df1-c032-420d-924e-ebc3b469070e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.026764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.027492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb43e-9557-4c61-9745-8931807d373e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.027680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.028067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.028418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.029190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:08:45.029585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.031449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.032643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.033372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.033734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.034092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.034807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.036837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.049463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1145/2287] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:08:45.053626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.069868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1143/2288] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:44 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:45.070187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1f4d-79a1-439f-a3a2-72f4c09f5511 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.073832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.075457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.076211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.076489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.076758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.077695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.080040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.085021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011098e-4919-451b-9579-f5d719845cfc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.090941 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.091725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.092085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.092426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.093194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.095068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.107585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1144/2289] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:45.111206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.120721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1146/2290] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:45 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:45.124985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.125674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46d7a2-4d4e-484c-b92f-6125cc0ee2d1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.212764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.213632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.213916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.214202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.214306 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e244e-a893-4a6f-866f-12c36155a242 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.214861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.216501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.218022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:45.219022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.219641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.219927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.220340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.221058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.223238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.232318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1145/2291] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:45.239003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.254192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:45.255396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1d75d-0f58-4f39-9a7c-9085423e8de2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.265191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1147/2292] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:45 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:08:45.266345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.268871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a17e5b-af7d-41b5-8771-426d2a806539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.270156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17e5b-af7d-41b5-8771-426d2a806539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.270678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17e5b-af7d-41b5-8771-426d2a806539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.271101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17e5b-af7d-41b5-8771-426d2a806539 admin admin] PATH_INFO: `/v3/projects/6c5c4af8ffab4efb82f009d416ce94b1/users/7a31e9529e104d5e9ff2beef8efef41b/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.278228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac9cd-a382-458a-8f7a-6e19baa244c4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.284411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.285403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.285757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.286030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.286683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.288309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.293005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a17e5b-af7d-41b5-8771-426d2a806539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5c4af8ffab4efb82f009d416ce94b1, user_id=7a31e9529e104d5e9ff2beef8efef41b, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.299515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a17e5b-af7d-41b5-8771-426d2a806539 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.318678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1148/2293] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:45.320409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.334504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1146/2294] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:45 2022] PUT /identity/v3/projects/6c5c4af8ffab4efb82f009d416ce94b1/users/7a31e9529e104d5e9ff2beef8efef41b/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:45.337509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.337852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.338146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.345059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a89a6-21c8-493c-af79-46d64bc5efa5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.381305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] MFA Rules not processed for user `7a31e9529e104d5e9ff2beef8efef41b`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:45.382669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:45.471589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.473026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.473300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.473566 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.474222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.476431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.506717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1149/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:08:45.507766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.517294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1147/2296] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:45.525776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1218c-b163-4f11-b5ad-0e900c13089b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.526343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.529111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:45.532539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3383d-9bb7-4824-b82c-a3388ba5599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.533681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3383d-9bb7-4824-b82c-a3388ba5599e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.533996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3383d-9bb7-4824-b82c-a3388ba5599e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.534249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3383d-9bb7-4824-b82c-a3388ba5599e admin admin] PATH_INFO: `/v3/projects/dc058da67d7842f6b723e4bd22d47086/users/c7d17a5a96a74c3e903f08b41eb080fa/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.564067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3383d-9bb7-4824-b82c-a3388ba5599e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc058da67d7842f6b723e4bd22d47086, user_id=c7d17a5a96a74c3e903f08b41eb080fa, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.569750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3383d-9bb7-4824-b82c-a3388ba5599e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.599276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1150/2297] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:45 2022] PUT /identity/v3/projects/dc058da67d7842f6b723e4bd22d47086/users/c7d17a5a96a74c3e903f08b41eb080fa/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:45.604967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.605251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.605520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.632055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:45.634142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:45.634297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e769-327e-4ac1-a877-8d96619e2b68 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.713740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1151/2298] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:45.724198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:45.726896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:45.737168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b072f-28c6-408c-af58-7a56f86614e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.737788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b072f-28c6-408c-af58-7a56f86614e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.738282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b072f-28c6-408c-af58-7a56f86614e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.738561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b072f-28c6-408c-af58-7a56f86614e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.781219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:45.814850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b6958-a1b7-44e7-aeb8-010e00ce2886 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:45.817372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b072f-28c6-408c-af58-7a56f86614e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.818989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b072f-28c6-408c-af58-7a56f86614e5 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.821977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5da44-06e6-4731-bb25-5b17b14be1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:45.822746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5da44-06e6-4731-bb25-5b17b14be1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:45.823088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5da44-06e6-4731-bb25-5b17b14be1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:45.823446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5da44-06e6-4731-bb25-5b17b14be1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:45.841184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1148/2299] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:45.847089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5da44-06e6-4731-bb25-5b17b14be1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:45.848616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5da44-06e6-4731-bb25-5b17b14be1f7 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:45.860503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1152/2300] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:48.488975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b5a3-3522-44ee-8918-0c61da5a9f2d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:48.488975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b5a3-3522-44ee-8918-0c61da5a9f2d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:48.489639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b5a3-3522-44ee-8918-0c61da5a9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:48.520870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-89f7b5a3-3522-44ee-8918-0c61da5a9f2d None None] MFA Rules not processed for user `05a4d967d13742998fab86f157e550c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:48.522353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-89f7b5a3-3522-44ee-8918-0c61da5a9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:48.599760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1149/2301] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:53.061612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:53.062187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:53.062187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:53.072179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:53.090943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] MFA Rules not processed for user `0414977eaec5439e96231bdf7dc5837b`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:53.092195 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:53.165517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1153/2302] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:53.317979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:53.318499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:53.318611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:53.359417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] MFA Rules not processed for user `c7d17a5a96a74c3e903f08b41eb080fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:53.361832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:53.497420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1150/2303] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:53.499663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:53.513453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75495751-0bae-4e1a-b3ca-48ad3bdb834d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:53.521446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:53.522377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:53.522800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:53.523248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:53.524748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:53.526926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:53.601029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1154/2304] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:08:53 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:53.606031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:53.633397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a74521-4c6c-40e9-b364-5e988a54298b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:53.775000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:53.776459 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:53.776934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:53.777792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:53.779324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:53.782304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:53.811353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:53.830929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1151/2305] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:08:53 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:08:53.836407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:53.855551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854d558-6eb2-48ac-a9ea-a52a2d457d80 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:53.863186 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:53.863955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:53.864333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:53.864706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:53.865714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:53.873739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:53.917480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1155/2306] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:53.918362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:53.937301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc77ed-529e-41d0-bdc5-02be09a03400 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:53.951730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:53.952012 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:53.952430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:53.952833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] PATH_INFO: `/v3/projects/9cb79ea15c6948139548df3d4c3af916/users/0bf245f363fc4150880e29c14a8b269c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:53.982410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb79ea15c6948139548df3d4c3af916, user_id=0bf245f363fc4150880e29c14a8b269c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:53.986306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:54.032571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1152/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:53 2022] PUT /identity/v3/projects/9cb79ea15c6948139548df3d4c3af916/users/0bf245f363fc4150880e29c14a8b269c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:54.034298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:54.055509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b74d-a384-47d2-8f88-32600c053cde admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:54.179574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:54.180164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:54.180164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:54.180164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:54.180822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:54.182505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:54.207476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1156/2308] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:08:54.211899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:54.240427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2d285-b893-4aec-bb74-4130b39a2190 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:54.254135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105868e-79fd-41f1-8a9a-981e9acb48a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:54.255177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105868e-79fd-41f1-8a9a-981e9acb48a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:54.255571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105868e-79fd-41f1-8a9a-981e9acb48a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:54.256160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105868e-79fd-41f1-8a9a-981e9acb48a3 admin admin] PATH_INFO: `/v3/projects/9cb79ea15c6948139548df3d4c3af916/users/0bf245f363fc4150880e29c14a8b269c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:54.259135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105868e-79fd-41f1-8a9a-981e9acb48a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb79ea15c6948139548df3d4c3af916, user_id=0bf245f363fc4150880e29c14a8b269c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:54.263640 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105868e-79fd-41f1-8a9a-981e9acb48a3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:54.291431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1153/2309] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:08:54 2022] PUT /identity/v3/projects/9cb79ea15c6948139548df3d4c3af916/users/0bf245f363fc4150880e29c14a8b269c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:57.398188 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:57.415666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90716de0-6590-4038-bef4-ff432d649e93 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:57.556931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:57.557742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:57.558140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:57.558419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] PATH_INFO: `/v3/users/7a31e9529e104d5e9ff2beef8efef41b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:57.560430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a31e9529e104d5e9ff2beef8efef41b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:57.562538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:57.595713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:08:57.665789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a31e9529e104d5e9ff2beef8efef41b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:57.682371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a31e9529e104d5e9ff2beef8efef41b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:57.710125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a31e9529e104d5e9ff2beef8efef41b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:57.712024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a31e9529e104d5e9ff2beef8efef41b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:57.753175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a31e9529e104d5e9ff2beef8efef41b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:08:57.771876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1157/2310] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:08:57 2022] DELETE /identity/v3/users/7a31e9529e104d5e9ff2beef8efef41b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:08:57.778157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077db48-f696-4f41-9856-8bf6c8f617b8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:57.778720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077db48-f696-4f41-9856-8bf6c8f617b8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:57.778720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077db48-f696-4f41-9856-8bf6c8f617b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:57.856814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f077db48-f696-4f41-9856-8bf6c8f617b8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:57.861771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f077db48-f696-4f41-9856-8bf6c8f617b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:58.042304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1154/2311] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:58.059293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:58.060777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:58.164428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a3f09-84b7-472b-bf92-4d76a40fbef2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:58.169722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:58.170523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:58.171447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:58.172025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:58.190093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:58.192653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:58.209354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1158/2312] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:08:58.356724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:58.357143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:58.357509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:58.395873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:08:58.399482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:58.565036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1155/2313] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:08:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:08:58.580405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:58.582056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:58.767865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ae4c-1fb4-4ec2-9353-79e51bcdcc82 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:58.788277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a0e52-0e8a-47ab-9ace-75581473a633 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:58.789173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0e52-0e8a-47ab-9ace-75581473a633 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:58.789552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0e52-0e8a-47ab-9ace-75581473a633 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:58.789921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0e52-0e8a-47ab-9ace-75581473a633 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:58.807443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a0e52-0e8a-47ab-9ace-75581473a633 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:58.809305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a0e52-0e8a-47ab-9ace-75581473a633 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:08:58.829383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1159/2314] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:08:59.876754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:08:59.878314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:08:59.902451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d51ed-996d-46d6-892b-ba449824a41d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:08:59.911195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:08:59.912159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:08:59.913454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:08:59.913979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] PATH_INFO: `/v3/projects/6c5c4af8ffab4efb82f009d416ce94b1` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:08:59.915562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5c4af8ffab4efb82f009d416ce94b1)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:08:59.918063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:09:00.009544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5c4af8ffab4efb82f009d416ce94b1', 'request_id': 'req-b42ebdc5-ad02-4546-9634-563b8da7701a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:09:00.016570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5c4af8ffab4efb82f009d416ce94b1', 'request_id': 'req-b42ebdc5-ad02-4546-9634-563b8da7701a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:09:00.021864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:00.025075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5c4af8ffab4efb82f009d416ce94b1', 'request_id': 'req-b42ebdc5-ad02-4546-9634-563b8da7701a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:09:00.041533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] The token cache is being invalidate because project 6c5c4af8ffab4efb82f009d416ce94b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:09:00.041902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:09:00.042973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:09:00.045192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1156/2315] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:08:59 2022] DELETE /identity/v3/projects/6c5c4af8ffab4efb82f009d416ce94b1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:09:01.196297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d71f-5705-4593-9681-89f2d129f3c0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:01.196860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d71f-5705-4593-9681-89f2d129f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:01.196860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d71f-5705-4593-9681-89f2d129f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:01.229110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6772d71f-5705-4593-9681-89f2d129f3c0 None None] MFA Rules not processed for user `0bf245f363fc4150880e29c14a8b269c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:09:01.230335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6772d71f-5705-4593-9681-89f2d129f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:01.242692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:01.301827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1160/2316] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:09:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:09:01.315822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:09:01.317818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:01.395257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebdc5-ad02-4546-9634-563b8da7701a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:09:01.401993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:09:01.402953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:01.403435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:01.403914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:01.406159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:01.469439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:09:01.471035 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791af5d-6f3c-49b6-86c7-75fb527c1ecd service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:09:01.492194 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1157/2317] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:09:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:09:02.880416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:02.881086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:02.881086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:02.902638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] MFA Rules not processed for user `c7d17a5a96a74c3e903f08b41eb080fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:09:02.904034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:02.911273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1161/2318] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:09:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:09:11.476956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=2,keystone:SELECT=59,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:12.895866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=26 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:34.067409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2a138-6408-498d-afa8-aadf035e754f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:34.068008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2a138-6408-498d-afa8-aadf035e754f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:34.068205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2a138-6408-498d-afa8-aadf035e754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:34.091756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2ab2a138-6408-498d-afa8-aadf035e754f None None] MFA Rules not processed for user `d180fe83e8974fb79fc1d4ee31b2d630`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:09:34.093297 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2ab2a138-6408-498d-afa8-aadf035e754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:34.151216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1158/2319] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:09:44.076883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:09:44.078421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:44.143835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=25 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:44.152631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119ed4-0a24-40e4-9913-894bbf433bf5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:09:44.157520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:09:44.158375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:44.158655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:44.158927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:44.160887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:44.259622 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:09:44.260906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dc439-fdf0-46c8-b6b8-4233a3d3137a service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:09:44.274142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1162/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:09:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:09:54.267404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=50 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:09:56.735144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:56.735727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:56.735942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:56.759379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] MFA Rules not processed for user `a3a98eacfbcd4825bf62913759682a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:09:56.761761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:56.887037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1159/2321] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:09:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:09:57.844856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebc4f9-ea77-4a4e-b3b5-14aafc01dbbc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:57.846007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebc4f9-ea77-4a4e-b3b5-14aafc01dbbc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:57.846307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebc4f9-ea77-4a4e-b3b5-14aafc01dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:57.869109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-73ebc4f9-ea77-4a4e-b3b5-14aafc01dbbc None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:09:57.870349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-73ebc4f9-ea77-4a4e-b3b5-14aafc01dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:57.945795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1163/2322] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:09:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:09:57.978260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:09:57.980992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:09:58.076673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03224f-e2b8-479b-a94f-4813f269ea0b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:09:58.082205 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fba0d7-a7e1-4048-a876-eae2247058d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:09:58.083350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba0d7-a7e1-4048-a876-eae2247058d1 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:09:58.083350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba0d7-a7e1-4048-a876-eae2247058d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:09:58.083809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fba0d7-a7e1-4048-a876-eae2247058d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:09:58.093589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fba0d7-a7e1-4048-a876-eae2247058d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:09:58.095424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fba0d7-a7e1-4048-a876-eae2247058d1 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:09:58.104442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1160/2323] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 04:10:00.721076 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3440c9-7434-4009-98b3-7a1c9ee1ac81 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:00.721943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3440c9-7434-4009-98b3-7a1c9ee1ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:00.722222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3440c9-7434-4009-98b3-7a1c9ee1ac81 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:00.723572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1164/2324] 10.222.0.25 () {54 vars in 961 bytes} [Wed Aug 31 04:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:10:00.729229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:00.729731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:00.729904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:00.753408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] MFA Rules not processed for user `fa033d69cc014795896c16c63414f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:00.754704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:00.854331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1161/2325] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Aug 31 04:10:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:10:00.862733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3440c9-7434-4009-98b3-7a1c9ee1ac81 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:00.879142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3440c9-7434-4009-98b3-7a1c9ee1ac81 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:00.884854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:00.885715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:00.886041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:00.886447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:00.893709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:00.908658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:00.910688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86c44-93b9-46d3-a6c3-f89b97213809 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:00.924953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1165/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:10:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:10:03.291150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:03.301028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7a14d-5ab3-4749-9785-adb169dc24f0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:03.304925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:03.305731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:03.306171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:03.306598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:03.319122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:03.321730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:03.334368 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1162/2327] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:10:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:10:07.238038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb82a3-257d-41be-bf26-cfd529ace20d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:07.239057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb82a3-257d-41be-bf26-cfd529ace20d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:07.239685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb82a3-257d-41be-bf26-cfd529ace20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:07.267039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a7bb82a3-257d-41be-bf26-cfd529ace20d None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:07.269338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a7bb82a3-257d-41be-bf26-cfd529ace20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:07.293735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1166/2328] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:10:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:10:07.314195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:07.341154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51634-6863-4d65-a69f-95085a680bd9 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:07.356363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0762d10-0c8b-4a6f-9e8a-9ab179863e14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:07.357433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0762d10-0c8b-4a6f-9e8a-9ab179863e14 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:07.357922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0762d10-0c8b-4a6f-9e8a-9ab179863e14 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:07.359212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0762d10-0c8b-4a6f-9e8a-9ab179863e14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:07.380157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0762d10-0c8b-4a6f-9e8a-9ab179863e14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:07.385507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0762d10-0c8b-4a6f-9e8a-9ab179863e14 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:07.397152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1163/2329] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:10:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:17.261251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=34 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:17.394184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:17.914453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cb4ab-4f08-4045-8ee0-e5f50a72e0be None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:17.914736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cb4ab-4f08-4045-8ee0-e5f50a72e0be None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:17.915371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cb4ab-4f08-4045-8ee0-e5f50a72e0be None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:17.916849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1167/2330] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:10:17.923421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7a437-94de-4a73-9103-076cec3a8242 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:17.923698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7a437-94de-4a73-9103-076cec3a8242 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:17.923973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7a437-94de-4a73-9103-076cec3a8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:17.962190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c9c7a437-94de-4a73-9103-076cec3a8242 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:17.964974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c9c7a437-94de-4a73-9103-076cec3a8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:17.983743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1164/2331] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:10:17.998101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cb4ab-4f08-4045-8ee0-e5f50a72e0be None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:18.000359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-821cb4ab-4f08-4045-8ee0-e5f50a72e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:18.159232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cb4ab-4f08-4045-8ee0-e5f50a72e0be None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:18.163448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bada3-e52b-4bc8-a3c4-b1903273cd5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:18.164353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bada3-e52b-4bc8-a3c4-b1903273cd5d service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.164974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bada3-e52b-4bc8-a3c4-b1903273cd5d service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.165447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bada3-e52b-4bc8-a3c4-b1903273cd5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.178248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bada3-e52b-4bc8-a3c4-b1903273cd5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:18.180231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bada3-e52b-4bc8-a3c4-b1903273cd5d service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:18.207337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1168/2332] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:10:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:10:18.294773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b555-3dff-492a-a63e-99f63086c142 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.295148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b555-3dff-492a-a63e-99f63086c142 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.295538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b555-3dff-492a-a63e-99f63086c142 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.299403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1165/2333] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:10:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:10:18.306606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babebb05-dddb-45ab-b44d-265f5cfbe99b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.307176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babebb05-dddb-45ab-b44d-265f5cfbe99b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.307282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babebb05-dddb-45ab-b44d-265f5cfbe99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.338153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-babebb05-dddb-45ab-b44d-265f5cfbe99b None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:18.339389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-babebb05-dddb-45ab-b44d-265f5cfbe99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:18.346464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1169/2334] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:10:18.364581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b555-3dff-492a-a63e-99f63086c142 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:18.384664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b555-3dff-492a-a63e-99f63086c142 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:18.391674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92df9-e20c-434c-a929-ade578be6fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:18.392970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92df9-e20c-434c-a929-ade578be6fde service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.393503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92df9-e20c-434c-a929-ade578be6fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.394099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92df9-e20c-434c-a929-ade578be6fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.402876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce92df9-e20c-434c-a929-ade578be6fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:18.405316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce92df9-e20c-434c-a929-ade578be6fde service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:18.417127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1166/2335] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:10:18.515360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a56e-4296-4741-b0a1-922653e4d91f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.515757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a56e-4296-4741-b0a1-922653e4d91f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.516067 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a56e-4296-4741-b0a1-922653e4d91f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.518478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1170/2336] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:10:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:10:18.524380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f48a-bf70-4db9-9e75-f5cfe5edd276 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.525011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f48a-bf70-4db9-9e75-f5cfe5edd276 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.525283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f48a-bf70-4db9-9e75-f5cfe5edd276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.547991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e0f3f48a-bf70-4db9-9e75-f5cfe5edd276 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:18.549261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e0f3f48a-bf70-4db9-9e75-f5cfe5edd276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:18.559509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1167/2337] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:10:18.572131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a56e-4296-4741-b0a1-922653e4d91f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:18.593107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a56e-4296-4741-b0a1-922653e4d91f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:18.603274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:18.604109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:18.604522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:18.604962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:18.618860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:18.621059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:18.634403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1171/2338] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:10:23.384786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d558c61-711c-44a7-952a-07371a5f985d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:23.385348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d558c61-711c-44a7-952a-07371a5f985d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:23.385452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d558c61-711c-44a7-952a-07371a5f985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:23.405221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3d558c61-711c-44a7-952a-07371a5f985d None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:23.406430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3d558c61-711c-44a7-952a-07371a5f985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:23.413734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1168/2339] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:10:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:10:23.426670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:23.439950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649632-ee1a-4ae8-8d0e-f2ca78604f33 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:23.445470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:23.446191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:23.446539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:23.446816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:23.455546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:23.457184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:23.472187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1172/2340] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:23.950120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:23.950713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:23.951139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:23.973534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:23.974798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:23.982188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1169/2341] 10.222.0.25 () {58 vars in 967 bytes} [Wed Aug 31 04:10:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:10:24.001428 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:24.028736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0134-0ee5-4be1-852c-655e5e40967b service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:24.038598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:24.039377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:24.039669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:24.040161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:24.056411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:24.058088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:24.067977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1173/2342] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:10:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:26.289041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:26.291298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:26.367098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695fcd-3c2d-4977-8e18-8298cc3f1616 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:26.373041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:26.373614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:26.373885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:26.374204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] PATH_INFO: `/v3/users/d180fe83e8974fb79fc1d4ee31b2d630` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:26.375966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d180fe83e8974fb79fc1d4ee31b2d630)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:26.379050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:26.441817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd180fe83e8974fb79fc1d4ee31b2d630'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.453513 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd180fe83e8974fb79fc1d4ee31b2d630'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.454182 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd180fe83e8974fb79fc1d4ee31b2d630'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.454792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd180fe83e8974fb79fc1d4ee31b2d630'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.461687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-69f1a438-e5af-431e-9e95-2d4163c553e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd180fe83e8974fb79fc1d4ee31b2d630'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.475318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1170/2343] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:10:26 2022] DELETE /identity/v3/users/d180fe83e8974fb79fc1d4ee31b2d630 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:10:26.672089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:26.683599 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a058dd-3f0f-47b7-9e89-f82137fa210a service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:26.742282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:26.742922 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:26.743204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:26.743508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] PATH_INFO: `/v3/projects/2fdd76f7adbd45b996bdee0f197a2691` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:26.744627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fdd76f7adbd45b996bdee0f197a2691)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:26.746636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:26.795300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fdd76f7adbd45b996bdee0f197a2691', 'request_id': 'req-1b58df85-6eee-4276-a163-e9aa4501a4d0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.801872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fdd76f7adbd45b996bdee0f197a2691', 'request_id': 'req-1b58df85-6eee-4276-a163-e9aa4501a4d0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.803583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:26.811164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fdd76f7adbd45b996bdee0f197a2691', 'request_id': 'req-1b58df85-6eee-4276-a163-e9aa4501a4d0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.824513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] The token cache is being invalidate because project 2fdd76f7adbd45b996bdee0f197a2691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:10:26.824823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.825523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:10:26.827041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1174/2344] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:10:26 2022] DELETE /identity/v3/projects/2fdd76f7adbd45b996bdee0f197a2691 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:10:36.471796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:36.820613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:49.724569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:49.725095 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:49.725196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:49.744934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:10:49.746378 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:49.801416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1171/2345] 10.222.0.25 () {58 vars in 967 bytes} [Wed Aug 31 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:10:49.813890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:10:49.815281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:10:49.891187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58df85-6eee-4276-a163-e9aa4501a4d0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:10:49.897445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018f5d5-7439-4c89-b158-c80379bf4047 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:10:49.898045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f5d5-7439-4c89-b158-c80379bf4047 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:10:49.898321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f5d5-7439-4c89-b158-c80379bf4047 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:10:49.898585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f5d5-7439-4c89-b158-c80379bf4047 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:10:49.906911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018f5d5-7439-4c89-b158-c80379bf4047 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:10:49.908501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018f5d5-7439-4c89-b158-c80379bf4047 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:10:49.916520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1175/2346] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:10:59.795092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=25 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:10:59.913534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=32 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:31.878831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:11:31.880664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:31.953518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312047a4-0838-450f-9017-25c07264dbb8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:11:31.958690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:11:31.959375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:11:31.959650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:11:31.959967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:11:31.962293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:32.039678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:11:32.041178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:11:32.052230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1172/2347] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:11:33.072129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:11:33.072686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:11:33.072686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:11:33.092214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] MFA Rules not processed for user `05a4d967d13742998fab86f157e550c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:11:33.093505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:33.150996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1176/2348] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:11:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:11:34.564549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:11:34.566323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:34.577706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453a233-5e8a-4263-9ced-73c5cb5ab50e service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:11:34.582135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:11:34.582838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:11:34.583217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:11:34.583549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:11:34.585575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:34.610140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:11:34.612106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:11:34.628397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1173/2349] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:11:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:11:43.144227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=25 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:44.620882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=60 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:11:58.476497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:11:58.480189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:58.499582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20afb-fbdf-4304-a0ff-0e2d601a5a5b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:11:58.507159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:11:58.507786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:11:58.508056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:11:58.508319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:11:58.510373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:11:58.569367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:11:58.570981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a215a6-094e-4487-88c1-b2b70e5dae3e service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:11:58.580391 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1177/2350] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:11:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:06.075325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:06.077037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:06.091118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7dd99-7608-4de6-90d8-fc4610250186 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:06.098590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:06.099262 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:06.099546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:06.099844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:06.102216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:06.165657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:06.167199 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:06.176667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1174/2351] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:08.163509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:08.164049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:08.164049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:08.183826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] MFA Rules not processed for user `45de14fdfb4347918b93e8871d718043`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:12:08.185068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:08.193715 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1178/2352] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:12:08.523158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:08.532539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a03e-d0f8-4230-9b60-758007b65801 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:08.536428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:08.537230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:08.537567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:08.537892 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:08.539693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:08.549573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:08.551004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:08.559355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1175/2353] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:09.127532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:09.129301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:09.212906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c873eb3-bcdb-4fc2-8923-28f99651e870 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:09.217798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:09.218416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:09.218831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:09.219107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:09.220863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:09.232771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:09.234475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:09.244812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1179/2354] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:11.929714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:11.938579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586953a-4fbc-4712-9495-8853f9df3ee1 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:11.942292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:11.943245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:11.943518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:11.943783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:11.945628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:11.956868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:11.958344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:11.966956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1176/2355] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:12.823054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:12.835991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fae1-c6bb-4981-88e7-cfb81407f574 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:12.843198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:12.843897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:12.844424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:12.844760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:12.846804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:12.861405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:12.863018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47dc4a-b2c2-4ce8-a401-149e683c49ad service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:12.875402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1180/2356] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:20.048869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:20.066635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e3f48-1b72-4ad3-98a2-475f13870ca1 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:20.072463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:20.073195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:20.073565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:20.073906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:20.075827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:20.090255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:20.092817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:20.105536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1177/2357] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:22.870596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=69 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:26.457251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:26.457840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:26.457840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:26.478368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] MFA Rules not processed for user `a3a98eacfbcd4825bf62913759682a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:12:26.479593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:26.487983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1181/2358] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:12:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:12:30.100829 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=46 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:36.473025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:43.470343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:43.472227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:43.533630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6480b14-f00e-4f3f-b048-33975a4dc0e9 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:43.537844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:43.538500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:43.538756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:43.538998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:43.541010 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:43.602629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:43.604055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9294a5-a5a1-486e-a716-1bc78e29df86 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:43.616522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1178/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:46.884593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:46.894734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fb3e8-1a5c-4458-8dc7-e478291ecb4e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:46.899226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:46.899845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:46.900117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:46.900382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:46.902213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:46.914276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:46.915739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:46.925189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1182/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:53.610041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=48 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:12:56.004317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f022bb-73e2-40f3-92b8-21fae7614ee9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:56.004926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f022bb-73e2-40f3-92b8-21fae7614ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:56.004926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f022bb-73e2-40f3-92b8-21fae7614ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:56.024257 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c7f022bb-73e2-40f3-92b8-21fae7614ee9 None None] MFA Rules not processed for user `ba717b58c13d4bd7bd4b9399667345d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:12:56.025493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c7f022bb-73e2-40f3-92b8-21fae7614ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:56.032834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1179/2361] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:12:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:12:56.348865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:12:56.358820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823880-ef5e-46d3-9c43-bc9783e30a8a service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:12:56.362569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:12:56.363204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:56.363481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:56.363754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:56.365479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:56.375254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:12:56.376699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:12:56.384768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1183/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:12:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:12:59.970474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:12:59.971011 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:12:59.971117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:12:59.990799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:12:59.992070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:12:59.999844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1180/2363] 10.222.0.25 () {58 vars in 967 bytes} [Wed Aug 31 04:12:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:00.058917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:00.071290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e8298-85b2-493c-b0b0-a210d64da5f1 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:00.076096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:00.076700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:00.077011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:00.077280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:00.085853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:00.087458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:00.095767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1184/2364] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:13:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:13:04.173856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:04.196611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ae9c0-3c78-4289-a6f0-7ce05bd187ad None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:04.203692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:04.204420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:04.204847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:04.205159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:04.207418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:04.220726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:04.222715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:04.258172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1181/2365] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:07.853820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:07.858302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:07.998291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c131e38-01b7-4ecc-8833-650324237b66 service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:08.004270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:08.005029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:08.005369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:08.005701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] PATH_INFO: `/v3/users/0414977eaec5439e96231bdf7dc5837b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:08.006949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0414977eaec5439e96231bdf7dc5837b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:08.009483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:08.086650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0414977eaec5439e96231bdf7dc5837b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.094309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0414977eaec5439e96231bdf7dc5837b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.103354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0414977eaec5439e96231bdf7dc5837b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.104273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0414977eaec5439e96231bdf7dc5837b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.127626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0414977eaec5439e96231bdf7dc5837b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.136408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1185/2366] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:07 2022] DELETE /identity/v3/users/0414977eaec5439e96231bdf7dc5837b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:08.329850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:08.340719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378360-b478-4189-905e-2b5640ee6527 service placement] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:08.399211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:08.399761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:08.400040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:08.400311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] PATH_INFO: `/v3/projects/7a3953ba049948969986dd11cd33496f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:08.401429 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3953ba049948969986dd11cd33496f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:08.403330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:08.463230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3953ba049948969986dd11cd33496f', 'request_id': 'req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.471175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3953ba049948969986dd11cd33496f', 'request_id': 'req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.477964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3953ba049948969986dd11cd33496f', 'request_id': 'req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.494055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] The token cache is being invalidate because project 7a3953ba049948969986dd11cd33496f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:08.494514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.495249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.498236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1182/2367] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:08 2022] DELETE /identity/v3/projects/7a3953ba049948969986dd11cd33496f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:08.502437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:08.504006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:08.518092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44e3cc-d925-420b-b1a7-cc001084886d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:08.562485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:08.583714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:08.584367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:08.584647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:08.584950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] PATH_INFO: `/v3/users/d1d2f2f87e594a64acc664444fe4ea14` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:08.586123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d2f2f87e594a64acc664444fe4ea14)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:08.588115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:08.641690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d2f2f87e594a64acc664444fe4ea14'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.649085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d2f2f87e594a64acc664444fe4ea14'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.657744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d2f2f87e594a64acc664444fe4ea14'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.658625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d2f2f87e594a64acc664444fe4ea14'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.672440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d2f2f87e594a64acc664444fe4ea14'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:08.679030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1186/2368] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:08 2022] DELETE /identity/v3/users/d1d2f2f87e594a64acc664444fe4ea14 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:08.856007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:08.857666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:08.871823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1a215-8f32-4af1-acc7-c2152dbb7c3c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:08.945681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:08.946335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:08.946620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:08.947019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] PATH_INFO: `/v3/projects/6bf6a075673443b685e6ea043376dff6` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:08.948172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf6a075673443b685e6ea043376dff6)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:08.950157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:08.957103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:09.014041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf6a075673443b685e6ea043376dff6', 'request_id': 'req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:09.020524 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf6a075673443b685e6ea043376dff6', 'request_id': 'req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:09.026876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf6a075673443b685e6ea043376dff6', 'request_id': 'req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:09.039904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] The token cache is being invalidate because project 6bf6a075673443b685e6ea043376dff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:09.040193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:09.040795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:09.042604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1183/2369] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:08 2022] DELETE /identity/v3/projects/6bf6a075673443b685e6ea043376dff6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:15.112159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:15.113925 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:15.190082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab1d27-2072-456c-ab66-4189ba6ea308 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:15.293986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:15.294843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:15.295266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:15.295692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:15.297630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:15.342355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:15.394891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:15.396772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:15.409554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1187/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:18.977412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:18.978931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:18.992641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaa64f-9d6f-41c8-b87e-9ace582d3b31 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:18.997796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:18.998446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:18.998721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:18.998988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] PATH_INFO: `/v3/users/05a4d967d13742998fab86f157e550c7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.000137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a4d967d13742998fab86f157e550c7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.002120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.054564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a4d967d13742998fab86f157e550c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.067824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a4d967d13742998fab86f157e550c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.068729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a4d967d13742998fab86f157e550c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.069362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a4d967d13742998fab86f157e550c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.076620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-8e389b45-3e6b-47ca-b048-96c12a4c4e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a4d967d13742998fab86f157e550c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.092391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1184/2371] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:18 2022] DELETE /identity/v3/users/05a4d967d13742998fab86f157e550c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:19.282320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.292643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ec74-a3f1-4188-b862-804e6541163a service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.349538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.350171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.350445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.350714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] PATH_INFO: `/v3/projects/1e679bb0370e45849ef466721cb4e979` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.351916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e679bb0370e45849ef466721cb4e979)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.353873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.403259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e679bb0370e45849ef466721cb4e979', 'request_id': 'req-974b5978-9460-440a-a329-3da7e0ddf030'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.408746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e679bb0370e45849ef466721cb4e979', 'request_id': 'req-974b5978-9460-440a-a329-3da7e0ddf030'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.417738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e679bb0370e45849ef466721cb4e979', 'request_id': 'req-974b5978-9460-440a-a329-3da7e0ddf030'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.429144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] The token cache is being invalidate because project 1e679bb0370e45849ef466721cb4e979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:19.429467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.430124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-974b5978-9460-440a-a329-3da7e0ddf030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:19.431604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1188/2372] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:19 2022] DELETE /identity/v3/projects/1e679bb0370e45849ef466721cb4e979 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:19.438240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326826c-fc12-488c-a521-f75e8650395a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.438536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326826c-fc12-488c-a521-f75e8650395a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.438813 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326826c-fc12-488c-a521-f75e8650395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.458538 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1326826c-fc12-488c-a521-f75e8650395a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:19.459739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1326826c-fc12-488c-a521-f75e8650395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:19.524653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1185/2373] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:19.532698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.533035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.533312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.553487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:19.554788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:19.562810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1189/2374] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:19.567251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326826c-fc12-488c-a521-f75e8650395a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.577097 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326826c-fc12-488c-a521-f75e8650395a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.581685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.582284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.582563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.582831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.583479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:13:19.583779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.585530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.587204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:19.601534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1186/2375] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:13:19.606247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.615777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5acd-240b-4da3-9f13-785e8a20e74e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.621577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.622178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.622481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.622798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.623487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.625444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.655463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1190/2376] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:19 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:13:19.659825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.670812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302627b-9acf-43b4-a6b2-d0be088d32ec admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.747588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.748376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.748749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.749137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.749845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.751845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.777101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1187/2377] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:19 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:19.781415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.792693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d461abb-5a0e-4a41-ab6a-de429bf34a36 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.798828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.799874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.800313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.800890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.802209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.804478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.819040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1191/2378] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:19.819870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.831239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3535-f170-4fa2-9701-5a5bdba29e74 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.839218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb547a-357e-44bd-9469-d54282af058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.839979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb547a-357e-44bd-9469-d54282af058f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.840350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb547a-357e-44bd-9469-d54282af058f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.840688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb547a-357e-44bd-9469-d54282af058f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.841384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb547a-357e-44bd-9469-d54282af058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.843165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb547a-357e-44bd-9469-d54282af058f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.857195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1188/2379] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:13:19.861320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:19.874719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eee87-ace1-4197-9b46-2cf3dae9e26f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:19.880247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:19.880982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.881263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.881537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] PATH_INFO: `/v3/projects/363d5021a35a4ba9a69ca6d0c29755ab/users/7c57784950c14d70a874e4af8000fec7/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.894192 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:19.898894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=363d5021a35a4ba9a69ca6d0c29755ab, user_id=7c57784950c14d70a874e4af8000fec7, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:19.903079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:19.919208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1192/2380] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:19 2022] PUT /identity/v3/projects/363d5021a35a4ba9a69ca6d0c29755ab/users/7c57784950c14d70a874e4af8000fec7/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:19.929737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:19.930022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:19.930292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:19.961214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] MFA Rules not processed for user `7c57784950c14d70a874e4af8000fec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:19.962404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:20.034520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1189/2381] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:20.040501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.105022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904a85-17ec-4d4f-8fbd-fbac31798c7e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.110044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.110648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.110923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.111176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.111849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.113810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.143131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1193/2382] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:20.147336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.158068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b862f-8a35-4b50-a04c-75e65ed86040 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.225674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.226226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.226503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.226769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.227403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.229348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.238922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:20.264662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1190/2383] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:20 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:20.270817 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.282610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e73d9-07fa-483e-a6e4-f7239c938968 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.287792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.288448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.288743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.289049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.289692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.291316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.303294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1194/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:20.307690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.318362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062027a9-300c-46a0-8d48-bcec488b0a21 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.324508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.325195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.325482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.325751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] PATH_INFO: `/v3/projects/e2b41a9613af4b15811f43c15ec7831a/users/0fbb134dfc07404baabe9290383f4177/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.343888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b41a9613af4b15811f43c15ec7831a, user_id=0fbb134dfc07404baabe9290383f4177, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.346593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.362137 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1191/2385] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:20 2022] PUT /identity/v3/projects/e2b41a9613af4b15811f43c15ec7831a/users/0fbb134dfc07404baabe9290383f4177/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:20.366286 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.377014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9496a4a-03de-4001-b3ee-f2f8e02fd458 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.436421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b55013-7a19-4ff0-8a8e-9697891292cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.437063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55013-7a19-4ff0-8a8e-9697891292cb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.437328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55013-7a19-4ff0-8a8e-9697891292cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.437605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b55013-7a19-4ff0-8a8e-9697891292cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.438266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b55013-7a19-4ff0-8a8e-9697891292cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.439876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b55013-7a19-4ff0-8a8e-9697891292cb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.449630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1195/2386] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:13:20.454250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.465031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9c6c-fcc9-45a8-b31a-84da3e615db2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.470022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.470664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.470963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.471216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] PATH_INFO: `/v3/projects/e2b41a9613af4b15811f43c15ec7831a/users/0fbb134dfc07404baabe9290383f4177/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.473365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b41a9613af4b15811f43c15ec7831a, user_id=0fbb134dfc07404baabe9290383f4177, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.476065 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.486216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1192/2387] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:20 2022] PUT /identity/v3/projects/e2b41a9613af4b15811f43c15ec7831a/users/0fbb134dfc07404baabe9290383f4177/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:20.498794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.499144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.499467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.532649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] MFA Rules not processed for user `0fbb134dfc07404baabe9290383f4177`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:20.533895 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:20.584395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:20.606935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1196/2388] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:20.618824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.621313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:20.679502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf6227-f039-4b3d-9a02-bd2154647561 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.683927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc7ae-f026-4e79-b4bd-ac71486f6772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.684519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc7ae-f026-4e79-b4bd-ac71486f6772 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.684818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc7ae-f026-4e79-b4bd-ac71486f6772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.685109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc7ae-f026-4e79-b4bd-ac71486f6772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.694897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc7ae-f026-4e79-b4bd-ac71486f6772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.696317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc7ae-f026-4e79-b4bd-ac71486f6772 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.706688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1193/2389] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:20.772527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:20.838513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd26633-096b-4559-b49d-9bec0ed93404 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:20.843764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:20.844394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.844677 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.844981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] PATH_INFO: `/v3/users/7c57784950c14d70a874e4af8000fec7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.846168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c57784950c14d70a874e4af8000fec7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:20.848095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:20.899099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c57784950c14d70a874e4af8000fec7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:20.906318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c57784950c14d70a874e4af8000fec7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:20.915964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c57784950c14d70a874e4af8000fec7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:20.916663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c57784950c14d70a874e4af8000fec7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:20.930371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c57784950c14d70a874e4af8000fec7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:20.936418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1197/2390] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:20 2022] DELETE /identity/v3/users/7c57784950c14d70a874e4af8000fec7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:20.941321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:20.941603 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:20.941875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:20.961688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:20.962884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:21.034024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1194/2391] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:13:21.043464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:21.044988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:21.103759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24bac-d025-4020-b7c3-e60f2312dcd7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:21.107716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:21.108338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:21.108611 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:21.108892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:21.120242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:21.122107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:21.133315 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1198/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:21.414179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:21.415724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:21.432599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f690-8a64-48a4-907e-7af346a47eb7 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:21.437340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:21.438056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:21.438336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:21.438607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] PATH_INFO: `/v3/projects/363d5021a35a4ba9a69ca6d0c29755ab` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:21.439874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=363d5021a35a4ba9a69ca6d0c29755ab)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:21.441855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:21.489478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363d5021a35a4ba9a69ca6d0c29755ab', 'request_id': 'req-40fa7106-0278-4d21-8170-a40741d183fd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.491388 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:21.496488 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363d5021a35a4ba9a69ca6d0c29755ab', 'request_id': 'req-40fa7106-0278-4d21-8170-a40741d183fd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.503958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363d5021a35a4ba9a69ca6d0c29755ab', 'request_id': 'req-40fa7106-0278-4d21-8170-a40741d183fd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.517952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] The token cache is being invalidate because project 363d5021a35a4ba9a69ca6d0c29755ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:21.518237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.518915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.520415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1195/2393] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:21 2022] DELETE /identity/v3/projects/363d5021a35a4ba9a69ca6d0c29755ab => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:21.524657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:21.534422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccffbb3-155b-4be9-9ea2-f4344cc6f038 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:21.539886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:21.607026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:21.607679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:21.607991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:21.608314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] PATH_INFO: `/v3/users/0fbb134dfc07404baabe9290383f4177` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:21.609541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbb134dfc07404baabe9290383f4177)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:21.611482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:21.667131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbb134dfc07404baabe9290383f4177'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.674004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbb134dfc07404baabe9290383f4177'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.682814 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbb134dfc07404baabe9290383f4177'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.683561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbb134dfc07404baabe9290383f4177'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.696838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a1bb2aef-e377-4160-a63a-95b6b1ef78ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbb134dfc07404baabe9290383f4177'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:21.702745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1199/2394] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:21 2022] DELETE /identity/v3/users/0fbb134dfc07404baabe9290383f4177 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:21.993822 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:21.995467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:22.009644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa7106-0278-4d21-8170-a40741d183fd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.072495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.073253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.073614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.073953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] PATH_INFO: `/v3/projects/e2b41a9613af4b15811f43c15ec7831a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.075111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b41a9613af4b15811f43c15ec7831a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.077134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.125408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b41a9613af4b15811f43c15ec7831a', 'request_id': 'req-324d4f91-cc59-4384-b9b2-42703af5e4fe'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:22.131673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b41a9613af4b15811f43c15ec7831a', 'request_id': 'req-324d4f91-cc59-4384-b9b2-42703af5e4fe'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:22.137697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b41a9613af4b15811f43c15ec7831a', 'request_id': 'req-324d4f91-cc59-4384-b9b2-42703af5e4fe'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:22.152014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] The token cache is being invalidate because project e2b41a9613af4b15811f43c15ec7831a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:22.152284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:22.152942 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-324d4f91-cc59-4384-b9b2-42703af5e4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:22.154437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1196/2395] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:21 2022] DELETE /identity/v3/projects/e2b41a9613af4b15811f43c15ec7831a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:22.159416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.160070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.160440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.181292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:22.182616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:22.249956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1200/2396] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:22.258103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.258393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.258666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.279289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:22.280411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:22.288569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1197/2397] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:22.293070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.305273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a97b-6f7b-4652-b78c-125a8ccc01e4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.313905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.314908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.315309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.315822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.316864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:13:22.317369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.320144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.332210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1201/2398] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:13:22.336582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.345947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6ad1d-b3ed-4066-b529-01fdfa05fa32 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.350899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.351585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.351864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.352131 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.352764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.354689 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.385780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1198/2399] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:22.390096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.400141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430de3-6f36-4037-afab-d14073627fda admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.411858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:22.457916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.458528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.458803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.459074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.459718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.461780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.490266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1202/2400] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:13:22.494584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.505679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3930b4-8cc2-4910-b3ea-e466482d08f6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.512163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.512760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.513067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.513332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.513976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.515569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.525825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1199/2401] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:22.530070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.540439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46915a24-12b9-4c5e-9851-0ba111dcafbe admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.546166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f26e5-f6ea-442e-94f2-0819ead5426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.546771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f26e5-f6ea-442e-94f2-0819ead5426e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.547044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f26e5-f6ea-442e-94f2-0819ead5426e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.547310 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f26e5-f6ea-442e-94f2-0819ead5426e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.547971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f26e5-f6ea-442e-94f2-0819ead5426e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.549645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f26e5-f6ea-442e-94f2-0819ead5426e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.562117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1203/2402] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:13:22.566361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.576737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f762-4df6-4f5c-9bd0-2a3c73a54e82 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.581589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.582277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.582550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.582881 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] PATH_INFO: `/v3/projects/831770f8251741a38d96e9a0f6a30b2c/users/c5edaed845fd4d59b42b2f6f339ea37d/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.597785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831770f8251741a38d96e9a0f6a30b2c, user_id=c5edaed845fd4d59b42b2f6f339ea37d, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.600425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.615585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1200/2403] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:22 2022] PUT /identity/v3/projects/831770f8251741a38d96e9a0f6a30b2c/users/c5edaed845fd4d59b42b2f6f339ea37d/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:22.627342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.627627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.627899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.658509 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] MFA Rules not processed for user `c5edaed845fd4d59b42b2f6f339ea37d`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:22.660347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:22.733116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1204/2404] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:22.737494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.747124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:22.805764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39371c-c712-479e-b6e5-963005148206 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.811287 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.811903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.812181 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.812430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.813130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.815107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.844837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1201/2405] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:22.849105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.860682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88195e-0bd0-456d-9d13-c7e999fa6a86 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.917572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.918175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.918452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.918719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.919374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.921316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.946338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1205/2406] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:22 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:22.950450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.961029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a743-bd0e-454a-9d3e-3743a99c918a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:22.966605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:22.967209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:22.967492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:22.967760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:22.968406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:22.970055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:22.981241 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1202/2407] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:22.986406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:22.997601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6e00e-83dd-4469-8c8c-9c29ff9782c7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.002786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505841-643e-4c7f-9f0b-46bc6a811b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.003399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505841-643e-4c7f-9f0b-46bc6a811b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.003675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505841-643e-4c7f-9f0b-46bc6a811b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.003937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505841-643e-4c7f-9f0b-46bc6a811b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.004594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505841-643e-4c7f-9f0b-46bc6a811b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.006250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505841-643e-4c7f-9f0b-46bc6a811b49 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.016653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1206/2408] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:23.020947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.030888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cad4d-71ff-4303-a2b2-15002a4a5b3c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.035725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.036397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.036674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.036984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] PATH_INFO: `/v3/projects/43a8cce353ca437bbd8d11f897c0c2c2/users/020838a4fc60462abf7b7e506858be15/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.052562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a8cce353ca437bbd8d11f897c0c2c2, user_id=020838a4fc60462abf7b7e506858be15, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.055353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.070447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1203/2409] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:23 2022] PUT /identity/v3/projects/43a8cce353ca437bbd8d11f897c0c2c2/users/020838a4fc60462abf7b7e506858be15/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:23.080825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.081120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.081393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.088625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:23.110914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] MFA Rules not processed for user `020838a4fc60462abf7b7e506858be15`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:23.112160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:23.180289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1207/2410] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:23.184701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.255003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9ec4-c7a9-4e1b-a435-c9118800833f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.260155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.260774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.261090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.261894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.262119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.264420 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.293692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1204/2411] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:23 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:13:23.298110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.310023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a94177-8a94-43cd-a90a-62cf4acce51c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.374218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.374218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.374218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.374218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.374706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.376604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.401743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1208/2412] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:23 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:23.405963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.416340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5a33-4160-4053-88e2-b328582e31cb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.420982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.421581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.421855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.422120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.422765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.424371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.435839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1205/2413] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:23.440323 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.450438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55c45-c0ea-4894-a2da-2365800ac9e9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.455528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.456187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.456465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.456739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] PATH_INFO: `/v3/projects/5c325d8e4e2140d0aad7fc93d9ea3c69/users/2f10f6d04ca0415f92a5449d9edeb04f/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.472118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c325d8e4e2140d0aad7fc93d9ea3c69, user_id=2f10f6d04ca0415f92a5449d9edeb04f, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.474810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.488757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1209/2414] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:23 2022] PUT /identity/v3/projects/5c325d8e4e2140d0aad7fc93d9ea3c69/users/2f10f6d04ca0415f92a5449d9edeb04f/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:23.492897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.503722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c76f3-ce29-41bd-8d3b-2f9ebb6592bd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.534472 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:23.563984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bcbb9-a42a-4f10-ba15-6fab1c8f2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.564599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bcbb9-a42a-4f10-ba15-6fab1c8f2d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.564923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bcbb9-a42a-4f10-ba15-6fab1c8f2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.565203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bcbb9-a42a-4f10-ba15-6fab1c8f2d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.565850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bcbb9-a42a-4f10-ba15-6fab1c8f2d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.567454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bcbb9-a42a-4f10-ba15-6fab1c8f2d1d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.577520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1206/2415] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:23.581946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.592779 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48e12f-4953-40d7-a89f-1e2c4edd7843 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.598543 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.599208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.599494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.599763 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] PATH_INFO: `/v3/projects/5c325d8e4e2140d0aad7fc93d9ea3c69/users/2f10f6d04ca0415f92a5449d9edeb04f/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.601924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c325d8e4e2140d0aad7fc93d9ea3c69, user_id=2f10f6d04ca0415f92a5449d9edeb04f, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.604577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.614899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1210/2416] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:23 2022] PUT /identity/v3/projects/5c325d8e4e2140d0aad7fc93d9ea3c69/users/2f10f6d04ca0415f92a5449d9edeb04f/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:23.625398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.625682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.625954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.656404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] MFA Rules not processed for user `2f10f6d04ca0415f92a5449d9edeb04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:23.657683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:23.734944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1207/2417] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:13:23.747232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.749354 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:23.797918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:23.810246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa638e-5568-4094-8879-128d4602aebf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.814262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.814870 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.815147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.815423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.824971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.826525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.835994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1211/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:23.881238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:23.883142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:23.895808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31c883-0ca4-4ebe-b7e3-c5509b82b579 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:23.900458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7403c3b-e45c-4078-aafe-c28f8d1b9fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:23.901123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7403c3b-e45c-4078-aafe-c28f8d1b9fdd service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:23.901401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7403c3b-e45c-4078-aafe-c28f8d1b9fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:23.901674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7403c3b-e45c-4078-aafe-c28f8d1b9fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:23.963725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7403c3b-e45c-4078-aafe-c28f8d1b9fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:23.965223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7403c3b-e45c-4078-aafe-c28f8d1b9fdd service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:23.974973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1208/2419] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:26.978879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:27.042710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a784fb-3ec3-4749-a073-a03b3d52af5e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:27.047765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:27.048389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:27.048666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:27.048958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] PATH_INFO: `/v3/users/c5edaed845fd4d59b42b2f6f339ea37d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:27.050094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5edaed845fd4d59b42b2f6f339ea37d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:27.051997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:27.100512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5edaed845fd4d59b42b2f6f339ea37d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.107447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5edaed845fd4d59b42b2f6f339ea37d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.116032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5edaed845fd4d59b42b2f6f339ea37d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.116668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5edaed845fd4d59b42b2f6f339ea37d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.129459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5edaed845fd4d59b42b2f6f339ea37d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.135264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1212/2420] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:26 2022] DELETE /identity/v3/users/c5edaed845fd4d59b42b2f6f339ea37d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:27.139853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:27.140329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:27.140450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:27.159645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:27.160777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:27.207518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:27.222795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1209/2421] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:27.233801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:27.235228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:27.292533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9b29-5fbd-4c8e-8200-f47028e55d1b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:27.296464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:27.297086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:27.297357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:27.297651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:27.306636 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:27.308095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:27.317487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1213/2422] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:27.611193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:27.612827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:27.626371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b55e3-54d2-46bd-a6fe-aa35ba2d1328 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:27.631656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:27.632486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:27.632870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:27.633159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] PATH_INFO: `/v3/projects/831770f8251741a38d96e9a0f6a30b2c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:27.634328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831770f8251741a38d96e9a0f6a30b2c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:27.636278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:27.690979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831770f8251741a38d96e9a0f6a30b2c', 'request_id': 'req-78e7c92b-5842-4cac-894f-d94b2a5bdf75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.697505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831770f8251741a38d96e9a0f6a30b2c', 'request_id': 'req-78e7c92b-5842-4cac-894f-d94b2a5bdf75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.703276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831770f8251741a38d96e9a0f6a30b2c', 'request_id': 'req-78e7c92b-5842-4cac-894f-d94b2a5bdf75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.717703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] The token cache is being invalidate because project 831770f8251741a38d96e9a0f6a30b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:27.717992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.718687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.720064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1210/2423] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:27 2022] DELETE /identity/v3/projects/831770f8251741a38d96e9a0f6a30b2c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:27.724429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:27.741587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbcd50-9ba3-4392-9814-01cadc28cecb service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:27.747369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:27.811170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:27.811802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:27.812077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:27.812346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] PATH_INFO: `/v3/users/020838a4fc60462abf7b7e506858be15` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:27.813440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020838a4fc60462abf7b7e506858be15)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:27.815378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:27.865781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020838a4fc60462abf7b7e506858be15'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.874288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020838a4fc60462abf7b7e506858be15'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.883685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020838a4fc60462abf7b7e506858be15'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.884421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020838a4fc60462abf7b7e506858be15'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.898652 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020838a4fc60462abf7b7e506858be15'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:27.904722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1214/2424] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:27 2022] DELETE /identity/v3/users/020838a4fc60462abf7b7e506858be15 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:28.178555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:28.180103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:28.198837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c92b-5842-4cac-894f-d94b2a5bdf75 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:28.262306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:28.262962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:28.263236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:28.263509 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] PATH_INFO: `/v3/projects/43a8cce353ca437bbd8d11f897c0c2c2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:28.264637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a8cce353ca437bbd8d11f897c0c2c2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:28.266561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:28.323403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a8cce353ca437bbd8d11f897c0c2c2', 'request_id': 'req-eff96d63-72f4-4b50-8dab-5bc678a95fe3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.330141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a8cce353ca437bbd8d11f897c0c2c2', 'request_id': 'req-eff96d63-72f4-4b50-8dab-5bc678a95fe3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.336196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a8cce353ca437bbd8d11f897c0c2c2', 'request_id': 'req-eff96d63-72f4-4b50-8dab-5bc678a95fe3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.349901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] The token cache is being invalidate because project 43a8cce353ca437bbd8d11f897c0c2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:28.350183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.350814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.352350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1211/2425] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:28 2022] DELETE /identity/v3/projects/43a8cce353ca437bbd8d11f897c0c2c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:28.357218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:28.358705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:28.372103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873c7d-ef62-4bc4-89f6-a6f83a732f54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:28.433160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:28.433787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:28.434062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:28.434327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] PATH_INFO: `/v3/users/2f10f6d04ca0415f92a5449d9edeb04f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:28.435452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f10f6d04ca0415f92a5449d9edeb04f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:28.437421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:28.473644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:28.489260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f10f6d04ca0415f92a5449d9edeb04f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.498525 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f10f6d04ca0415f92a5449d9edeb04f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.507656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f10f6d04ca0415f92a5449d9edeb04f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.508258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f10f6d04ca0415f92a5449d9edeb04f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.522734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c2746ad5-2dea-4778-9f4c-ba096332227c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f10f6d04ca0415f92a5449d9edeb04f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.529105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1215/2426] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:28 2022] DELETE /identity/v3/users/2f10f6d04ca0415f92a5449d9edeb04f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:28.840959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:28.842598 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:28.853812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:28.864616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96d63-72f4-4b50-8dab-5bc678a95fe3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:28.929449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:28.930089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:28.930374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:28.930660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] PATH_INFO: `/v3/projects/5c325d8e4e2140d0aad7fc93d9ea3c69` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:28.931790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c325d8e4e2140d0aad7fc93d9ea3c69)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:28.933726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:28.985415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c325d8e4e2140d0aad7fc93d9ea3c69', 'request_id': 'req-9c57ae66-e220-475f-8e2c-38b98cd60ffb'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:28.998421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c325d8e4e2140d0aad7fc93d9ea3c69', 'request_id': 'req-9c57ae66-e220-475f-8e2c-38b98cd60ffb'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:29.011027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c325d8e4e2140d0aad7fc93d9ea3c69', 'request_id': 'req-9c57ae66-e220-475f-8e2c-38b98cd60ffb'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:29.031397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] The token cache is being invalidate because project 5c325d8e4e2140d0aad7fc93d9ea3c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:29.031729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:29.032848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9c57ae66-e220-475f-8e2c-38b98cd60ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:29.035421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1212/2427] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:28 2022] DELETE /identity/v3/projects/5c325d8e4e2140d0aad7fc93d9ea3c69 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:29.044769 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.045208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.045579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.074907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:29.076205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:29.144339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1216/2428] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:29.156144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.156430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.156731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.177664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:29.178869 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:29.188367 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1213/2429] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:29.192955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.204153 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c61f15-cb2e-44e5-bf50-e020bc22ee3c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.210287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.211100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.211422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.211908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.212872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:13:29.213183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.215202 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.227534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1217/2430] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:13:29.232238 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.241993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b235b-a504-4e94-9d4c-3eab0b3dbc08 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.248468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.249096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.249356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.249621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.250247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.252151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.282177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1214/2431] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:29.287960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.302546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b9bf7-8026-4cc0-af70-cd6181bae44a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.383712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.384517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.384926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.385200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.385957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.388326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.416065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1218/2432] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:29.420537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.433576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfecf2-526c-42b2-8570-c5f3d94eb054 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.439124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.439939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.440325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.440596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.441484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.443394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.454782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1215/2433] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:29.458812 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.469325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497505d0-14fa-4f7f-8fb6-b93e124b32b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.474985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a4086-7b27-4d1f-b65d-91bb14bcbdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.475582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a4086-7b27-4d1f-b65d-91bb14bcbdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.475852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a4086-7b27-4d1f-b65d-91bb14bcbdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.476220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a4086-7b27-4d1f-b65d-91bb14bcbdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.476898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a4086-7b27-4d1f-b65d-91bb14bcbdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.478539 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a4086-7b27-4d1f-b65d-91bb14bcbdf2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.489892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1219/2434] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:29.494220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.506361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93de8-815d-45a3-bc97-bebc3869bdd0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.512149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.512862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.513164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.513435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] PATH_INFO: `/v3/projects/fc0b2906f34e4937a7a15fafc6daa176/users/fa4135b7f55f4198a3557e0c0880101e/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.529854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0b2906f34e4937a7a15fafc6daa176, user_id=fa4135b7f55f4198a3557e0c0880101e, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.532507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.547629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1216/2435] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:29 2022] PUT /identity/v3/projects/fc0b2906f34e4937a7a15fafc6daa176/users/fa4135b7f55f4198a3557e0c0880101e/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:13:29.564988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.565276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.565561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.602768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:29.606026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] MFA Rules not processed for user `fa4135b7f55f4198a3557e0c0880101e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:29.608253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:29.676340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1220/2436] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:29.681055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.718150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:29.764568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abeaf3-cd4e-457d-ad94-714099786ae8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.769901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.770540 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.770811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.771064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.771687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.773619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.801424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1217/2437] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:29.805494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.815982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717c763-4cbf-4f24-9c5f-ff0f1980da16 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.872209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.872828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.873119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.873390 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.874025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.875951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.901200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1221/2438] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:29 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:29.905419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.915923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c9c5-bb56-4eee-b054-0f90401429f0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.921312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.921920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.922195 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.922464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.923107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.924711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:29.935846 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1218/2439] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:29.939972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:29.950172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e605db-8040-4005-94c5-f089f72b1821 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:29.955717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:29.956362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:29.956635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:29.956935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] PATH_INFO: `/v3/projects/709bedab94344cde82cdc0198c7d22e7/users/982ca913fa564341a69dab22ce2772bc/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:29.974163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709bedab94344cde82cdc0198c7d22e7, user_id=982ca913fa564341a69dab22ce2772bc, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:29.976847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:30.010961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1222/2440] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:29 2022] PUT /identity/v3/projects/709bedab94344cde82cdc0198c7d22e7/users/982ca913fa564341a69dab22ce2772bc/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:30.018831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:30.029490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180fe65-b19d-4c2c-95ce-e1f70017f5d0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:30.088382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441abef9-0618-486c-bf8a-3af509997d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:30.088974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abef9-0618-486c-bf8a-3af509997d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:30.089251 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abef9-0618-486c-bf8a-3af509997d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:30.089577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abef9-0618-486c-bf8a-3af509997d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:30.090252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441abef9-0618-486c-bf8a-3af509997d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:30.091953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441abef9-0618-486c-bf8a-3af509997d93 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:30.101831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1219/2441] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:30.108527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:30.122533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548441-398c-4023-8922-b5b31fd68d84 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:30.127903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:30.128549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:30.128845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:30.129113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] PATH_INFO: `/v3/projects/709bedab94344cde82cdc0198c7d22e7/users/982ca913fa564341a69dab22ce2772bc/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:30.131122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709bedab94344cde82cdc0198c7d22e7, user_id=982ca913fa564341a69dab22ce2772bc, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:30.133843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:30.144184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1223/2442] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:30 2022] PUT /identity/v3/projects/709bedab94344cde82cdc0198c7d22e7/users/982ca913fa564341a69dab22ce2772bc/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:30.155201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:30.155574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:30.155926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:30.196271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] MFA Rules not processed for user `982ca913fa564341a69dab22ce2772bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:30.197654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:30.274467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1220/2443] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:13:30.286415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:30.288382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:30.344032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1216b-f1c7-4631-9b75-83069e4c4574 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:30.347601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e2e4e-eb1a-480f-b780-9b711adb3eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:30.348193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2e4e-eb1a-480f-b780-9b711adb3eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:30.348480 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2e4e-eb1a-480f-b780-9b711adb3eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:30.348733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2e4e-eb1a-480f-b780-9b711adb3eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:30.357380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:30.412997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e2e4e-eb1a-480f-b780-9b711adb3eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:30.414429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e2e4e-eb1a-480f-b780-9b711adb3eb6 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:30.423463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1224/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:33.009589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:33.040637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:33.079270 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c85b-fc4f-428e-942b-3939900592ac None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:33.084502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:33.085166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:33.085445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:33.085714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] PATH_INFO: `/v3/users/fa4135b7f55f4198a3557e0c0880101e` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:33.086877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4135b7f55f4198a3557e0c0880101e)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:33.088924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:33.137946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4135b7f55f4198a3557e0c0880101e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.150549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4135b7f55f4198a3557e0c0880101e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.151254 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4135b7f55f4198a3557e0c0880101e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.151929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4135b7f55f4198a3557e0c0880101e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.159569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4135b7f55f4198a3557e0c0880101e'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.174736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1221/2445] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:33 2022] DELETE /identity/v3/users/fa4135b7f55f4198a3557e0c0880101e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:33.179782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:33.180336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:33.180436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:33.200720 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:33.201943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:33.273551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1225/2446] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:13:33.281159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:33.283335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:33.353002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646abb-bba5-4ccd-9afc-89543c4c43d0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:33.358715 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:33.359359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:33.359668 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:33.359931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:33.371218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:33.372820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:33.384862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1222/2447] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:33.669617 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:33.671183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:33.683855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c80452-87f1-4d8a-8e7b-b40b31710a7b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:33.689784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:33.690552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:33.691661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:33.692008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] PATH_INFO: `/v3/projects/fc0b2906f34e4937a7a15fafc6daa176` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:33.693463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0b2906f34e4937a7a15fafc6daa176)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:33.695375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:33.747142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0b2906f34e4937a7a15fafc6daa176', 'request_id': 'req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.753670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0b2906f34e4937a7a15fafc6daa176', 'request_id': 'req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.763586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0b2906f34e4937a7a15fafc6daa176', 'request_id': 'req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.775650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] The token cache is being invalidate because project fc0b2906f34e4937a7a15fafc6daa176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:33.775930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.776680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.778316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1226/2448] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:33 2022] DELETE /identity/v3/projects/fc0b2906f34e4937a7a15fafc6daa176 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:33.782450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:33.793790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13302852-3a41-47cc-b828-c66f7aaa3312 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:33.842823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:33.857641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:33.858271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:33.858553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:33.858816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] PATH_INFO: `/v3/users/982ca913fa564341a69dab22ce2772bc` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:33.859945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982ca913fa564341a69dab22ce2772bc)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:33.861949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:33.910733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982ca913fa564341a69dab22ce2772bc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.924045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982ca913fa564341a69dab22ce2772bc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.924736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982ca913fa564341a69dab22ce2772bc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.925382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982ca913fa564341a69dab22ce2772bc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.932486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66372c96-407b-4103-bb11-73a37c031435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982ca913fa564341a69dab22ce2772bc'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:33.945724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1223/2449] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:13:33 2022] DELETE /identity/v3/users/982ca913fa564341a69dab22ce2772bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:34.223337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.225061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:34.244312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fb7f6-1d7c-418e-9a98-6efd5c536f06 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.276399 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:34.304477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.304933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.305197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.305490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] PATH_INFO: `/v3/projects/709bedab94344cde82cdc0198c7d22e7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.306798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709bedab94344cde82cdc0198c7d22e7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.308973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.367888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709bedab94344cde82cdc0198c7d22e7', 'request_id': 'req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:34.375180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709bedab94344cde82cdc0198c7d22e7', 'request_id': 'req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:34.385364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709bedab94344cde82cdc0198c7d22e7', 'request_id': 'req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:34.397997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] The token cache is being invalidate because project 709bedab94344cde82cdc0198c7d22e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:13:34.398301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:34.398920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2de4c77b-5cfa-489e-bfcc-358b3b3d98f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:13:34.400444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1227/2450] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:13:34 2022] DELETE /identity/v3/projects/709bedab94344cde82cdc0198c7d22e7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:34.406624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.407124 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.407235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.427924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:34.429163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:34.493223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1224/2451] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:34.501550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.501836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.502110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.522330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:34.523532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:34.532247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1228/2452] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:34.536722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.549001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747ab1-ca77-4df5-ad7b-7ef6802def12 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.554334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.554985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.555272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.555512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.556159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:13:34.556455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.558109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.569817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1225/2453] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:13:34.574299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.583497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafe44-570c-47fc-9f33-fc80125783ae None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.589183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.589792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.590064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.590326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.590955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.592902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.625789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1229/2454] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:13:34 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:13:34.630022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.640663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e30aed-699c-4ac5-9a49-3a1cdd44a806 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.690997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:34.698935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.699562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.699842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.700115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.700776 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.703382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.727408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1226/2455] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:13:34 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:13:34.733333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.744196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8b626-dfaf-4349-8731-3b6445c5af24 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.750268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.751002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.751524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.752095 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.753061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.754962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.765533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1230/2456] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:34.770121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.783564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8063b-d4b1-4ea1-9d77-f498f6786016 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.789898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3826c-79bf-46fe-b6e4-36fa0eb6b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.790527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3826c-79bf-46fe-b6e4-36fa0eb6b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.790797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3826c-79bf-46fe-b6e4-36fa0eb6b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.791061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3826c-79bf-46fe-b6e4-36fa0eb6b7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.791704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3826c-79bf-46fe-b6e4-36fa0eb6b7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.793323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3826c-79bf-46fe-b6e4-36fa0eb6b7d6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.804312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1227/2457] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:13:34.808600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:34.819008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ac188-9753-495b-aaef-918e8ce8ad3a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:34.825447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:34.825997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.826248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.826618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] PATH_INFO: `/v3/projects/071a3b240fd34b578370c230f267eede/users/513d3760d4954077aed8ae9dec9a653d/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.844009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071a3b240fd34b578370c230f267eede, user_id=513d3760d4954077aed8ae9dec9a653d, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:34.846778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:34.863605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1231/2458] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:13:34 2022] PUT /identity/v3/projects/071a3b240fd34b578370c230f267eede/users/513d3760d4954077aed8ae9dec9a653d/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:13:34.874462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4aeb-5875-4626-8219-58309ff0636e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:34.874745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4aeb-5875-4626-8219-58309ff0636e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:34.875014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce4aeb-5875-4626-8219-58309ff0636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:34.902651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9dce4aeb-5875-4626-8219-58309ff0636e None None] MFA Rules not processed for user `513d3760d4954077aed8ae9dec9a653d`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:13:34.903832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9dce4aeb-5875-4626-8219-58309ff0636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:34.992027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1228/2459] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:13:35.004490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:13:35.006469 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:13:35.065869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1394f-5f9e-4d6d-a327-7daf8920cf20 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:13:35.070009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:13:35.070600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:13:35.070955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:13:35.071225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:13:35.079557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:13:35.081016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:13:35.089848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1232/2460] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:13:44.989103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:13:45.085926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:10.504213 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:10.504730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:10.504876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:10.524450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:10.525757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:10.585819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1229/2461] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:10.648070 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:10.649577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:10.737587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63cf5b-63bd-4f99-98e6-27b5ccaf0238 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:10.743110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff76d-8e31-4927-9aab-49f00156e9ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:10.743731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff76d-8e31-4927-9aab-49f00156e9ee service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:10.744007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff76d-8e31-4927-9aab-49f00156e9ee service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:10.744307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff76d-8e31-4927-9aab-49f00156e9ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:10.755906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff76d-8e31-4927-9aab-49f00156e9ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:10.757559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff76d-8e31-4927-9aab-49f00156e9ee service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:10.769140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1233/2462] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:14:12.670821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:12.752530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359a42a-ec4f-4837-9b17-e2f9d39f0300 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:12.757853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:12.758674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:12.758955 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:12.759225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] PATH_INFO: `/v3/users/513d3760d4954077aed8ae9dec9a653d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:12.760399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513d3760d4954077aed8ae9dec9a653d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:12.762816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:12.814969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513d3760d4954077aed8ae9dec9a653d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:12.829064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513d3760d4954077aed8ae9dec9a653d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:12.829811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513d3760d4954077aed8ae9dec9a653d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:12.830415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513d3760d4954077aed8ae9dec9a653d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:12.839508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513d3760d4954077aed8ae9dec9a653d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:12.855526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1230/2463] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:14:12 2022] DELETE /identity/v3/users/513d3760d4954077aed8ae9dec9a653d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:14:12.860366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:12.860913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:12.861178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:12.882803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:12.884302 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:12.954379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1234/2464] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:12.966449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:12.968549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:13.005127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:13.051206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d2a13-aedd-46ee-94aa-e1602f6d0872 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:13.055676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b973c-b78a-4ac0-878c-c22c51814c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:13.056696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b973c-b78a-4ac0-878c-c22c51814c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:13.057005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b973c-b78a-4ac0-878c-c22c51814c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:13.057275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b973c-b78a-4ac0-878c-c22c51814c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:13.069544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b973c-b78a-4ac0-878c-c22c51814c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:13.071008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b973c-b78a-4ac0-878c-c22c51814c28 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:13.082785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1231/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:14:13.520363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:13.522160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:13.535682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710add-ac42-4d63-94cc-f6d062253544 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:13.540898 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:13.541701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:13.542069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:13.542435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] PATH_INFO: `/v3/projects/071a3b240fd34b578370c230f267eede` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:13.543801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071a3b240fd34b578370c230f267eede)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:13.546005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:13.665927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071a3b240fd34b578370c230f267eede', 'request_id': 'req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:13.674481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071a3b240fd34b578370c230f267eede', 'request_id': 'req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:13.686580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071a3b240fd34b578370c230f267eede', 'request_id': 'req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:13.705771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] The token cache is being invalidate because project 071a3b240fd34b578370c230f267eede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:14:13.706244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:13.707102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a7c48c89-9b5b-43db-8a1b-c826a4f817f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:13.708784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1235/2466] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:14:13 2022] DELETE /identity/v3/projects/071a3b240fd34b578370c230f267eede => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:14:13.715118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:13.716066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:13.716512 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:13.754949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:13.761126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:13.843055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1232/2467] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:13.850967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:13.851252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:13.851526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:13.877874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:13.879279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:13.890674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1236/2468] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:13.894431 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:13.907676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522bb1-c613-4d5e-8dfd-8005167a0004 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:13.912903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:13.913442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:13.913724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:13.913997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:13.914691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:14:13.914996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:13.916686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:13.931586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1233/2469] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:14:13.935767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:13.946080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554a4e4-8afc-48b8-91be-075b258ad205 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:13.950502 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:13.951138 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:13.951411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:13.951689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:13.952352 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:13.954308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:13.959798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:13.992682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1237/2470] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:14:13 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:14:13.996557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.008837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12090-15c7-4b04-ae63-73ec7ebbd3ce admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:14.073256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:14.073879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.074223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.074561 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.075265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:14.077495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:14.107641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1234/2471] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:14:13 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:14:14.109252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.122717 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f49c1-d2d7-4191-b992-b7473528138c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:14.127474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:14.128264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.128544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.128842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.129503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:14.131314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:14.143486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1238/2472] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:14:14.147858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.159160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935fc4b-48a0-493d-b34a-49e1acca7d4c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:14.163885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806cd0e-6b80-403c-8f0e-e2ec53d8b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:14.164496 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806cd0e-6b80-403c-8f0e-e2ec53d8b5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.164774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806cd0e-6b80-403c-8f0e-e2ec53d8b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.165171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806cd0e-6b80-403c-8f0e-e2ec53d8b5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.165859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806cd0e-6b80-403c-8f0e-e2ec53d8b5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:14.167510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806cd0e-6b80-403c-8f0e-e2ec53d8b5e6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:14.181772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1235/2473] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:14:14.186062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.197219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db5376-ca43-4e40-9097-02533b31af8a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:14.202411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:14.203479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.203479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.203802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] PATH_INFO: `/v3/projects/a97718cc354d4ae4851b747a4d5478d7/users/55726dbbb91a41479617b061eb6f9a2a/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.224681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97718cc354d4ae4851b747a4d5478d7, user_id=55726dbbb91a41479617b061eb6f9a2a, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:14.227424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:14.242866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1239/2474] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:14:14 2022] PUT /identity/v3/projects/a97718cc354d4ae4851b747a4d5478d7/users/55726dbbb91a41479617b061eb6f9a2a/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:14:14.253996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.254411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.254784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.283854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] MFA Rules not processed for user `55726dbbb91a41479617b061eb6f9a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:14.285265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:14.308418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:14.364656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1236/2475] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:14:14.375869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.377735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:14.455494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ec1d6-b1d0-46dd-afab-213d05c38ad1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:14.459356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109795fc-8f4a-4217-b4da-183509fba05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:14.460083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109795fc-8f4a-4217-b4da-183509fba05d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.460396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109795fc-8f4a-4217-b4da-183509fba05d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.460732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109795fc-8f4a-4217-b4da-183509fba05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.475130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109795fc-8f4a-4217-b4da-183509fba05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:14.476765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109795fc-8f4a-4217-b4da-183509fba05d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:14.487561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1240/2476] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:14:14.521610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.639463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39e6ee-539d-4aa8-822d-a631ef300e4a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:14.644330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:14.645298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.645858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.646440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] PATH_INFO: `/v3/users/55726dbbb91a41479617b061eb6f9a2a` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.647876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55726dbbb91a41479617b061eb6f9a2a)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:14.649868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:14.714503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55726dbbb91a41479617b061eb6f9a2a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:14.731975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55726dbbb91a41479617b061eb6f9a2a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:14.732780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55726dbbb91a41479617b061eb6f9a2a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:14.733385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55726dbbb91a41479617b061eb6f9a2a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:14.742733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55726dbbb91a41479617b061eb6f9a2a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:14.762084 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1237/2477] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:14:14 2022] DELETE /identity/v3/users/55726dbbb91a41479617b061eb6f9a2a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:14:14.767664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:14.768163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:14.768743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:14.792732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:14.794586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:14.903542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1241/2478] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:14.919058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:14.920589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:15.003285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:15.024463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40809f9-2914-4551-a923-67ffc9985669 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:15.028433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c370d8-f824-4cb1-a70e-445d87696524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:15.030374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c370d8-f824-4cb1-a70e-445d87696524 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.030729 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c370d8-f824-4cb1-a70e-445d87696524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.031069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c370d8-f824-4cb1-a70e-445d87696524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.042049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c370d8-f824-4cb1-a70e-445d87696524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:15.043476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c370d8-f824-4cb1-a70e-445d87696524 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:15.054171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1238/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:14:15.386406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:15.387994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:15.422033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a0f07-0c52-4304-a615-3e8df4168459 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:15.430706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:15.432145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.432575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.433043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] PATH_INFO: `/v3/projects/a97718cc354d4ae4851b747a4d5478d7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.434350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97718cc354d4ae4851b747a4d5478d7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:15.436569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:15.505561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:15.507880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97718cc354d4ae4851b747a4d5478d7', 'request_id': 'req-c6817185-a051-4dc5-8fde-d06d58c8e6df'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:15.516276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97718cc354d4ae4851b747a4d5478d7', 'request_id': 'req-c6817185-a051-4dc5-8fde-d06d58c8e6df'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:15.527035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97718cc354d4ae4851b747a4d5478d7', 'request_id': 'req-c6817185-a051-4dc5-8fde-d06d58c8e6df'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:15.540285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] The token cache is being invalidate because project a97718cc354d4ae4851b747a4d5478d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:14:15.540642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:15.541330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6817185-a051-4dc5-8fde-d06d58c8e6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:14:15.542852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1242/2480] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:14:15 2022] DELETE /identity/v3/projects/a97718cc354d4ae4851b747a4d5478d7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:14:15.547847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.548147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.548397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.572196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:15.573461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:15.656865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.657112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1239/2481] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:15.661215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.661589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.693424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:15.694626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:15.715201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1243/2482] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:15.716577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:15.727261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d17aa-2a85-4298-b068-0422e5fda4f5 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:15.732964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:15.734165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.734165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.734165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.735425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:14:15.735425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:15.737704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:15.753463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1240/2483] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:14:15.759092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:15.776132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c547-08ef-438b-af61-76cc9ee2eeda None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:15.781385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:15.782013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.782389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.782690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.783386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:15.785334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:15.837705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1244/2484] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:14:15 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:14:15.842965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:15.854325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563a951-ad08-4b4e-9ec5-0bef9f71256b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:15.927334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:15.927966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:15.928239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:15.928504 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:15.929175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:15.931098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:15.982679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1241/2485] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:14:15 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:14:15.984022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:15.996346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e024705-420d-42e1-8f34-d46a97c4613f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:16.001861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:16.003673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:16.003673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:16.003673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:16.003972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:16.006078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:16.018907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1245/2486] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:14:16.088733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:16.099726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f86c62-8fad-4e22-ae73-d9dcefe9241b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:16.105064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bb8a-15c2-4f99-b37f-686e506571ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:16.105734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bb8a-15c2-4f99-b37f-686e506571ba admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:16.106015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bb8a-15c2-4f99-b37f-686e506571ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:16.106288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bb8a-15c2-4f99-b37f-686e506571ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:16.106961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8bb8a-15c2-4f99-b37f-686e506571ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:16.108571 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8bb8a-15c2-4f99-b37f-686e506571ba admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:16.125729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:16.132850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1242/2487] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:14:16.138485 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f347907-987d-4ba9-834a-3028793ee418 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:16.143926 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:16.144941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:16.145396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:16.145827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] PATH_INFO: `/v3/projects/1cb9d28793614b7d927219f382fc78c6/users/0f860f5f5ba44e55a0bcb47b96ee0131/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:16.165989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb9d28793614b7d927219f382fc78c6, user_id=0f860f5f5ba44e55a0bcb47b96ee0131, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:16.169062 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:16.188956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1246/2488] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:14:16 2022] PUT /identity/v3/projects/1cb9d28793614b7d927219f382fc78c6/users/0f860f5f5ba44e55a0bcb47b96ee0131/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:14:16.199844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239915cf-afc5-4842-b2c7-48522dd31433 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:16.200208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239915cf-afc5-4842-b2c7-48522dd31433 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:16.200416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239915cf-afc5-4842-b2c7-48522dd31433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:16.235369 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-239915cf-afc5-4842-b2c7-48522dd31433 None None] MFA Rules not processed for user `0f860f5f5ba44e55a0bcb47b96ee0131`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:16.236597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-239915cf-afc5-4842-b2c7-48522dd31433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:16.292154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:16.337283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1243/2489] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:16.338478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:16.340666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:16.428593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206b4fb-2cef-490d-b2d7-e411c6341cfe admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:16.432482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a68dc-69a3-4e54-aef4-68f2de3f3d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:16.433157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a68dc-69a3-4e54-aef4-68f2de3f3d56 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:16.433435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a68dc-69a3-4e54-aef4-68f2de3f3d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:16.433722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a68dc-69a3-4e54-aef4-68f2de3f3d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:16.444036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a68dc-69a3-4e54-aef4-68f2de3f3d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:16.445640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a68dc-69a3-4e54-aef4-68f2de3f3d56 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:16.455927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1247/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:14:17.864013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b92d0-fd0e-4c0a-a80f-94aa4a95e8b0 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:17.864573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b92d0-fd0e-4c0a-a80f-94aa4a95e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:17.864674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b92d0-fd0e-4c0a-a80f-94aa4a95e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:17.886835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b13b92d0-fd0e-4c0a-a80f-94aa4a95e8b0 None None] MFA Rules not processed for user `0f860f5f5ba44e55a0bcb47b96ee0131`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:17.888503 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b13b92d0-fd0e-4c0a-a80f-94aa4a95e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:17.900609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1244/2491] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:23.500553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b76fd-c699-4127-8f56-970443467d7b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:23.501059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b76fd-c699-4127-8f56-970443467d7b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:23.501157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b76fd-c699-4127-8f56-970443467d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:23.521465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a68b76fd-c699-4127-8f56-970443467d7b None None] MFA Rules not processed for user `a3a98eacfbcd4825bf62913759682a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:23.522706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a68b76fd-c699-4127-8f56-970443467d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:23.577499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1248/2492] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:14:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:27.079171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52e7e3-0f8a-447e-9032-7a14042016a0 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.079771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52e7e3-0f8a-447e-9032-7a14042016a0 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.079771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52e7e3-0f8a-447e-9032-7a14042016a0 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.081079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1245/2493] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:14:27.090902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37739-ef5c-44e1-a66d-9fa1a507c08a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.091374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37739-ef5c-44e1-a66d-9fa1a507c08a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.091659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37739-ef5c-44e1-a66d-9fa1a507c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.111799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-46f37739-ef5c-44e1-a66d-9fa1a507c08a None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:27.113080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-46f37739-ef5c-44e1-a66d-9fa1a507c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:27.127356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:27.186112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1249/2494] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:27.198465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52e7e3-0f8a-447e-9032-7a14042016a0 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:27.200275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8c52e7e3-0f8a-447e-9032-7a14042016a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:27.258196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52e7e3-0f8a-447e-9032-7a14042016a0 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:27.261791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1bc44-82ba-49de-a0f9-c7223dd3baff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:27.262406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1bc44-82ba-49de-a0f9-c7223dd3baff service glance] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.262687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1bc44-82ba-49de-a0f9-c7223dd3baff service glance] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.263001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1bc44-82ba-49de-a0f9-c7223dd3baff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.273505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1bc44-82ba-49de-a0f9-c7223dd3baff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:27.274969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1bc44-82ba-49de-a0f9-c7223dd3baff service glance] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:27.286249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1246/2495] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:14:27.371724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d37cb-2870-4c27-8d2a-b6968caa863e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.372112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d37cb-2870-4c27-8d2a-b6968caa863e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.372527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d37cb-2870-4c27-8d2a-b6968caa863e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.374284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1250/2496] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:14:27.379351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b2f5d-b1ae-4328-8648-0061f3236a07 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.379632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b2f5d-b1ae-4328-8648-0061f3236a07 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.379934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b2f5d-b1ae-4328-8648-0061f3236a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.405711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2d0b2f5d-b1ae-4328-8648-0061f3236a07 None None] MFA Rules not processed for user `36e52c9271db4196a138de433b75b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:27.407565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d0b2f5d-b1ae-4328-8648-0061f3236a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:27.470151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1247/2497] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:14:27.482426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d37cb-2870-4c27-8d2a-b6968caa863e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:27.484463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ab4d37cb-2870-4c27-8d2a-b6968caa863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:27.499918 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d37cb-2870-4c27-8d2a-b6968caa863e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:27.503999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116973-eb44-45af-ab95-0a0aa1eb78b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:27.504630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116973-eb44-45af-ab95-0a0aa1eb78b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.504941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116973-eb44-45af-ab95-0a0aa1eb78b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.505215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116973-eb44-45af-ab95-0a0aa1eb78b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.512366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed116973-eb44-45af-ab95-0a0aa1eb78b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:27.513860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed116973-eb44-45af-ab95-0a0aa1eb78b1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:27.521936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1251/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:14:27.620258 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ee60-8c6c-4155-8d5f-88be3e8a5295 None None] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.620984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ee60-8c6c-4155-8d5f-88be3e8a5295 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.621344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5ee60-8c6c-4155-8d5f-88be3e8a5295 None None] PATH_INFO: `/` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.623453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1248/2499] 10.222.0.25 () {54 vars in 921 bytes} [Wed Aug 31 04:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 04:14:27.632495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ede5-afd0-4c3c-9e84-326ec0864ee7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.632788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ede5-afd0-4c3c-9e84-326ec0864ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.633140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ede5-afd0-4c3c-9e84-326ec0864ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.654732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6285ede5-afd0-4c3c-9e84-326ec0864ee7 None None] MFA Rules not processed for user `15d3488259a0490bb05a0c49688f5957`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:27.655947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6285ede5-afd0-4c3c-9e84-326ec0864ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:27.665623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1252/2500] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Aug 31 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:14:27.677328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ee60-8c6c-4155-8d5f-88be3e8a5295 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:27.689428 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5ee60-8c6c-4155-8d5f-88be3e8a5295 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:27.693209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:27.693830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:27.694104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:27.694373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:27.705324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:27.706834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:27.723341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1249/2501] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:14:30.469198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eaa00-587b-4b5d-81c5-3815c486435b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:30.469691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eaa00-587b-4b5d-81c5-3815c486435b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:30.469946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eaa00-587b-4b5d-81c5-3815c486435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:30.502198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-489eaa00-587b-4b5d-81c5-3815c486435b None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:30.503594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-489eaa00-587b-4b5d-81c5-3815c486435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:30.596304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1253/2502] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:14:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:30.609046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:30.610591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:30.687685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:30.724418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c20bf-eab5-4e03-bca3-8a0b72ddb4f1 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:30.729816 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:30.730502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:30.730859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:30.731202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:30.740113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:30.744328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:30.754958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1250/2503] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:14:40.594707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=72 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:40.751299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=13 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:14:56.318046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:56.318589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:56.318589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:56.350518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:14:56.351736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:56.360546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1254/2504] 10.222.0.25 () {58 vars in 967 bytes} [Wed Aug 31 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:14:56.387670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:56.401145 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03dc4d-a9ee-4883-ab14-b9748275a1f6 service swift] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:56.409300 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f4138-a9e2-4e1e-817e-8d5dcaaa353f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:56.409990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f4138-a9e2-4e1e-817e-8d5dcaaa353f service swift] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:56.410365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f4138-a9e2-4e1e-817e-8d5dcaaa353f service swift] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:56.410663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f4138-a9e2-4e1e-817e-8d5dcaaa353f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:56.420646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f4138-a9e2-4e1e-817e-8d5dcaaa353f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:56.422703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f4138-a9e2-4e1e-817e-8d5dcaaa353f service swift] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:56.431758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1251/2505] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:14:59.523523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:14:59.525100 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:59.622628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62589ece-ef47-4c53-89e9-39029b293d84 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:14:59.628820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:14:59.629465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:14:59.629735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:14:59.629998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:14:59.632113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:14:59.645330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:14:59.647071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:14:59.657445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1255/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:14:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:00.487866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7329-1cba-421d-ac09-6be4274a122c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:00.488364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7329-1cba-421d-ac09-6be4274a122c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:00.488568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7329-1cba-421d-ac09-6be4274a122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:00.511650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-deff7329-1cba-421d-ac09-6be4274a122c None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:00.513363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-deff7329-1cba-421d-ac09-6be4274a122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:00.524928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1252/2507] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:15:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:00.540170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:00.554711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3db6f-2a8d-4fb3-8680-75e8f511a5bb service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:00.560334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:00.561430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:00.561970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:00.562699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:00.574959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:00.576867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:00.586479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1256/2508] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:15:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:15:01.147709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236434f-650b-4e08-9691-e64bb72ae789 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:01.148090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236434f-650b-4e08-9691-e64bb72ae789 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:01.148362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236434f-650b-4e08-9691-e64bb72ae789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:01.167632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-6236434f-650b-4e08-9691-e64bb72ae789 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:01.168841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6236434f-650b-4e08-9691-e64bb72ae789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:01.176717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1253/2509] 10.222.0.25 () {58 vars in 967 bytes} [Wed Aug 31 04:15:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:01.189707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:01.201084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009481-7c5d-4868-a731-b17248cce368 service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:01.207075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:01.207913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:01.208262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:01.208551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:01.217880 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:01.219542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:01.227780 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1257/2510] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:15:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:15:01.493711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55354f9-7320-4d30-94af-69a3758273b9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:01.494212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55354f9-7320-4d30-94af-69a3758273b9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:01.494552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55354f9-7320-4d30-94af-69a3758273b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:01.515328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d55354f9-7320-4d30-94af-69a3758273b9 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:01.516995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d55354f9-7320-4d30-94af-69a3758273b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:01.526052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1254/2511] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Aug 31 04:15:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:01.540347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:01.552785 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca0f7f-e386-4fb7-81bc-d0d1d05418ae service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:01.558831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:01.559722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:01.560336 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:01.560852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:01.576262 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:01.578267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:01.602744 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1258/2512] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:15:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:15:01.992988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:01.993215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:01.993516 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:02.014036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] MFA Rules not processed for user `d23ba460295c4b9a85db43e43081a595`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:02.015265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:02.023647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1255/2513] 10.222.0.25 () {58 vars in 967 bytes} [Wed Aug 31 04:15:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:02.036119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:02.046940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067d867-4c1a-4b83-a028-5cb40894af3b service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:02.052039 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948c42-eb7c-4d51-a257-4d1a0da153b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '844c5874363b4611b64c3ffa2dc1033c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:02.052657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948c42-eb7c-4d51-a257-4d1a0da153b0 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:02.052965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948c42-eb7c-4d51-a257-4d1a0da153b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:02.053275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948c42-eb7c-4d51-a257-4d1a0da153b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:02.061680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948c42-eb7c-4d51-a257-4d1a0da153b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:02.063284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948c42-eb7c-4d51-a257-4d1a0da153b0 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:02.071856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1259/2514] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Aug 31 04:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 04:15:04.243807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:04.327936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cacec4-00dd-41cd-b312-9747209f6990 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:04.333201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:04.333826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:04.334098 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:04.334361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] PATH_INFO: `/v3/users/0f860f5f5ba44e55a0bcb47b96ee0131` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:04.335547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f860f5f5ba44e55a0bcb47b96ee0131)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:04.337483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:04.388210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f860f5f5ba44e55a0bcb47b96ee0131'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.399738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f860f5f5ba44e55a0bcb47b96ee0131'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.400389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f860f5f5ba44e55a0bcb47b96ee0131'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.401014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f860f5f5ba44e55a0bcb47b96ee0131'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.407684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f860f5f5ba44e55a0bcb47b96ee0131'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.426672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1256/2515] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:04 2022] DELETE /identity/v3/users/0f860f5f5ba44e55a0bcb47b96ee0131 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:04.432099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:04.432588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:04.432688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:04.474934 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:04.476113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:04.521337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:04.540517 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1260/2516] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:04.550635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:04.552236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:04.580768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:04.639793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2e2eb-8a94-4eaf-91d1-45229258def4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:04.644444 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157afe-fe9e-4a2f-85e8-9d4707356ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:04.645185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157afe-fe9e-4a2f-85e8-9d4707356ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:04.645520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157afe-fe9e-4a2f-85e8-9d4707356ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:04.645805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157afe-fe9e-4a2f-85e8-9d4707356ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:04.656036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157afe-fe9e-4a2f-85e8-9d4707356ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:04.657517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157afe-fe9e-4a2f-85e8-9d4707356ae1 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:04.668308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1257/2517] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:04.847538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:04.849113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:04.864832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934fd0-f232-40c3-bfc3-afb11d7efa3e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:04.870528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:04.871175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:04.871503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:04.871694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] PATH_INFO: `/v3/projects/1cb9d28793614b7d927219f382fc78c6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:04.873013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb9d28793614b7d927219f382fc78c6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:04.875082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:04.926758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb9d28793614b7d927219f382fc78c6', 'request_id': 'req-071bde75-07bc-4746-b8b4-bb2ec317758f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.932598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb9d28793614b7d927219f382fc78c6', 'request_id': 'req-071bde75-07bc-4746-b8b4-bb2ec317758f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.941839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb9d28793614b7d927219f382fc78c6', 'request_id': 'req-071bde75-07bc-4746-b8b4-bb2ec317758f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.955383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] The token cache is being invalidate because project 1cb9d28793614b7d927219f382fc78c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:04.955692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.956445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-071bde75-07bc-4746-b8b4-bb2ec317758f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:04.958528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1261/2518] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:04 2022] DELETE /identity/v3/projects/1cb9d28793614b7d927219f382fc78c6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:04.963421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:04.963710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:04.963981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.017288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:05.018494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:05.078526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1258/2519] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:05.086815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.087094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.087367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.108866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:05.110119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:05.119346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1262/2520] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:05.124245 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.134722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659db29c-1dcc-412a-8eda-6a1514243251 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.139468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.140093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.140371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.140644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.141333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:15:05.141633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.143274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.155017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1259/2521] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:15:05.159460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.169491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606520a-ae7f-4b02-a047-fc64657fabb6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.174643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.175256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.175535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.175809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.176484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.178497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.209560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1263/2522] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:05 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:05.214260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.228495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a62dee-2edc-47d2-9dd0-77b241d34e00 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.290328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.291080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.291080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.291390 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.292024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.294031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.311565 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:05.321216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1260/2523] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:05 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:05.323200 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.335901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1a0f3-9744-4963-9cd2-bcd6e3966c8a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.341651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.342267 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.342541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.342810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.343585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.345255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.356271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1264/2524] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:15:05.360502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.371563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5859c37-d0c3-4117-ae4b-39ea7962262c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.377277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b1aae-5163-4e18-b58e-909ae1040681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.377898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b1aae-5163-4e18-b58e-909ae1040681 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.378172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b1aae-5163-4e18-b58e-909ae1040681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.378432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b1aae-5163-4e18-b58e-909ae1040681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.379059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b1aae-5163-4e18-b58e-909ae1040681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.380761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b1aae-5163-4e18-b58e-909ae1040681 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.391627 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1261/2525] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:05.395988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.406248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e17cd2-599b-48a2-8761-d94318bc1f72 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.411117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.411856 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.412135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.412392 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] PATH_INFO: `/v3/projects/beb6be3e82044689a166299cd30c5fa5/users/00133c444368459eba906d2349488922/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.427441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb6be3e82044689a166299cd30c5fa5, user_id=00133c444368459eba906d2349488922, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.430178 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.444568 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1265/2526] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:05 2022] PUT /identity/v3/projects/beb6be3e82044689a166299cd30c5fa5/users/00133c444368459eba906d2349488922/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:05.449650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782bee-05cf-456c-914a-b9a19417a694 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.449940 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782bee-05cf-456c-914a-b9a19417a694 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.450236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14782bee-05cf-456c-914a-b9a19417a694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.469991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-14782bee-05cf-456c-914a-b9a19417a694 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:05.471192 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-14782bee-05cf-456c-914a-b9a19417a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:05.535932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1262/2527] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:15:05.549263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:05.551288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:05.613365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108ec3-7b13-406f-86c3-0db2753db080 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:05.617610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:05.618218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:05.618497 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:05.618777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:05.629081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:05.630569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:05.640370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1266/2528] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:06.647412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac32f9-0e9c-4af0-ab6b-92632be7fd10 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:06.648111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac32f9-0e9c-4af0-ab6b-92632be7fd10 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:06.648111 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac32f9-0e9c-4af0-ab6b-92632be7fd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:06.680706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b8ac32f9-0e9c-4af0-ab6b-92632be7fd10 None None] MFA Rules not processed for user `00133c444368459eba906d2349488922`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:06.681999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b8ac32f9-0e9c-4af0-ab6b-92632be7fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:06.764322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1263/2529] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:06.775844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:06.777941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:06.790140 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:06.878329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44921e7d-fd5d-4370-a926-117282ffa38c service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:06.883235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:06.884185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:06.884554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:06.884770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:06.895902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:06.897547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:06.908978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1267/2530] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:08.364422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:08.365395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:08.365833 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:08.388079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] MFA Rules not processed for user `00133c444368459eba906d2349488922`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:08.389607 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:08.397104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1264/2531] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:12.846583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:12.856702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48de3b-4490-4a01-9c50-c257d66f4578 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:12.860674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:12.861353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:12.861628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:12.861893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:12.863994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:12.876936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:12.878375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:12.887979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1268/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:14.853448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:14.855148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:14.868397 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2277b0-f197-491d-af1d-415d046ba367 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:14.873014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:14.873945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:14.874386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:14.874806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:14.876743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:14.943441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:14.945514 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:14.958086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1265/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:16.816793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:16.818298 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:16.989759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db8696-d117-4246-b280-f4d0a4d3e002 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:16.996265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:16.997608 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:16.998066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:16.998511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.001529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:17.017795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:17.020174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:17.032030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1269/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:17.175393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:17.177172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:17.194202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2873f-0e51-432d-a80d-71c66b87f91e service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:17.198945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:17.199647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:17.199922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:17.200189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] PATH_INFO: `/v3/users/ba717b58c13d4bd7bd4b9399667345d2` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.201340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba717b58c13d4bd7bd4b9399667345d2)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:17.203302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:17.205948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:17.253282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba717b58c13d4bd7bd4b9399667345d2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.265593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba717b58c13d4bd7bd4b9399667345d2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.266460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba717b58c13d4bd7bd4b9399667345d2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.267085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba717b58c13d4bd7bd4b9399667345d2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.274479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-dd3d5f45-679d-4247-a34c-e415cd2ce512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba717b58c13d4bd7bd4b9399667345d2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.290038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1266/2535] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:17 2022] DELETE /identity/v3/users/ba717b58c13d4bd7bd4b9399667345d2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:17.470171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:17.481786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4798-7fd5-4827-b81e-9ec04323a32b service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:17.531658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:17.553094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:17.553776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:17.554056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:17.554330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] PATH_INFO: `/v3/projects/aa6a9ef5090d4a0eafeae3ff3ef02de7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.555721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6a9ef5090d4a0eafeae3ff3ef02de7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:17.557767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:17.605614 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6a9ef5090d4a0eafeae3ff3ef02de7', 'request_id': 'req-93ec5d2d-1825-4fcc-984f-037efe7c115f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.611827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6a9ef5090d4a0eafeae3ff3ef02de7', 'request_id': 'req-93ec5d2d-1825-4fcc-984f-037efe7c115f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.619488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6a9ef5090d4a0eafeae3ff3ef02de7', 'request_id': 'req-93ec5d2d-1825-4fcc-984f-037efe7c115f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.634183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] The token cache is being invalidate because project aa6a9ef5090d4a0eafeae3ff3ef02de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:17.634454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.635135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-93ec5d2d-1825-4fcc-984f-037efe7c115f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:17.641697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1270/2536] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:17 2022] DELETE /identity/v3/projects/aa6a9ef5090d4a0eafeae3ff3ef02de7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:17.649232 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:17.649523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:17.650028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.673059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:17.674331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:17.751288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1267/2537] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:17.759738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:17.760021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:17.760293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.780440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:17.781621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:17.789602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1271/2538] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:17.794046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:17.803855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34534a-36b9-41bb-8b78-0f4d12436c01 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:17.808691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:17.809331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:17.809604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:17.809873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.810521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:15:17.810823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:17.812424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:17.824222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1268/2539] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:15:17.831544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:17.846318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00847238-7209-4d3d-92fd-778e78ef989d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:17.853413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:17.854034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:17.854309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:17.854582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:17.855219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:17.857215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:17.909511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:17.914988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1272/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:17 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:17.920434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febf561-75c1-4a4c-ae47-0298f36740d0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.005448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.006259 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.007103 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.007386 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.008043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.010452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.028481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:18.034723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1269/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:17 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:15:18.039011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.049760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ceb959-13bc-49ff-94f8-6bbe43567fb1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.054626 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.055231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.055505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.055771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.056417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.058134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.067929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1273/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:18.071877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.081749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59566-9aa2-45e8-b2a4-aff1a11eac3a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.086430 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a747a-e1fe-4704-9a29-78a59cea136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.087033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a747a-e1fe-4704-9a29-78a59cea136b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.087313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a747a-e1fe-4704-9a29-78a59cea136b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.087584 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a747a-e1fe-4704-9a29-78a59cea136b admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.088236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a747a-e1fe-4704-9a29-78a59cea136b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.089864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a747a-e1fe-4704-9a29-78a59cea136b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.100326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1270/2543] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:18.104338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.115003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0c15-b99b-45e8-8dff-5b60d8cc3e4d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.119542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.120555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.120868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.121155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] PATH_INFO: `/v3/projects/04eb951a8f0a4fbfbe287410a8c9f85f/users/551731b030e242a4883d7f897338c0fe/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.136164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eb951a8f0a4fbfbe287410a8c9f85f, user_id=551731b030e242a4883d7f897338c0fe, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.138908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.152907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1274/2544] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:18 2022] PUT /identity/v3/projects/04eb951a8f0a4fbfbe287410a8c9f85f/users/551731b030e242a4883d7f897338c0fe/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:18.163442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.163730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.163992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.193189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] MFA Rules not processed for user `551731b030e242a4883d7f897338c0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:18.194457 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:18.266692 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1271/2545] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:18.271020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.343329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd067d-5c95-45bf-babb-c9fe3dc9217d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.352674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.352674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.352674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.352674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.353208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.353959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.370442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:18.389943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1275/2546] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:18 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:18.391166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.402891 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2baa0-2e9e-4c36-9046-c9abae92f1c9 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.464843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.465467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.465746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.466023 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.466685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.468609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.499461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1272/2547] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:18 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:18.502528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.513884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a27a-a629-48fe-a050-42995946d9bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.519454 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.520064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.520341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.520620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.521333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.523036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.533960 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1276/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:18.538333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.548817 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887e665-9be1-48c7-a2cc-032795c46166 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.554442 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.555100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.555381 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.555653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] PATH_INFO: `/v3/projects/b4aca6a4f4ce4620bc946734eaa45e99/users/a4caa4d9e1f840deaa8f46fb6be3f128/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.572741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aca6a4f4ce4620bc946734eaa45e99, user_id=a4caa4d9e1f840deaa8f46fb6be3f128, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.575456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.588703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1273/2549] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:18 2022] PUT /identity/v3/projects/b4aca6a4f4ce4620bc946734eaa45e99/users/a4caa4d9e1f840deaa8f46fb6be3f128/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:18.592701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.603383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4c24-2e13-4257-8222-2b066392d827 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.663756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a678831-d122-4ccb-a577-7bef63298497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.664380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a678831-d122-4ccb-a577-7bef63298497 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.664659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a678831-d122-4ccb-a577-7bef63298497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.664976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a678831-d122-4ccb-a577-7bef63298497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.665634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a678831-d122-4ccb-a577-7bef63298497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.667280 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a678831-d122-4ccb-a577-7bef63298497 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.677631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1277/2550] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:18.682090 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.692419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ea7ca-1c0e-4fe2-9397-a2fb4b489c4f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.697246 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.697922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.698193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.698451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] PATH_INFO: `/v3/projects/b4aca6a4f4ce4620bc946734eaa45e99/users/a4caa4d9e1f840deaa8f46fb6be3f128/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.706866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aca6a4f4ce4620bc946734eaa45e99, user_id=a4caa4d9e1f840deaa8f46fb6be3f128, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.708004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.719487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1274/2551] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:18 2022] PUT /identity/v3/projects/b4aca6a4f4ce4620bc946734eaa45e99/users/a4caa4d9e1f840deaa8f46fb6be3f128/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:18.731573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.732467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.732767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.767440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] MFA Rules not processed for user `a4caa4d9e1f840deaa8f46fb6be3f128`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:18.768695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:18.839483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1278/2552] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:18.850778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:18.852581 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:18.886965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:18.916588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157507-8f30-49fc-b1cb-b5e3c2957af2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:18.920732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc3091-01b7-4507-82bb-9609d58887b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:18.921423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3091-01b7-4507-82bb-9609d58887b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:18.921698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3091-01b7-4507-82bb-9609d58887b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:18.921971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc3091-01b7-4507-82bb-9609d58887b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:18.932127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3091-01b7-4507-82bb-9609d58887b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:18.933708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc3091-01b7-4507-82bb-9609d58887b4 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:18.943593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1275/2553] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:20.433401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:20.501266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134df23c-a758-4a61-8b56-56a252afb850 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:20.505848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:20.506491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:20.506824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:20.507097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] PATH_INFO: `/v3/users/551731b030e242a4883d7f897338c0fe` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:20.508235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551731b030e242a4883d7f897338c0fe)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:20.510201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:20.515170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:20.564579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551731b030e242a4883d7f897338c0fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:20.572448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551731b030e242a4883d7f897338c0fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:20.580940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551731b030e242a4883d7f897338c0fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:20.581577 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551731b030e242a4883d7f897338c0fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:20.593521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551731b030e242a4883d7f897338c0fe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:20.599631 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1279/2554] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:20 2022] DELETE /identity/v3/users/551731b030e242a4883d7f897338c0fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:20.604130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:20.604996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:20.605283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:20.630235 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:20.631555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:20.688021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1276/2555] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:15:20.698177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:20.700063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:20.760972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0839dc-69d1-4c62-8d2e-a0c8d2223124 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:20.765414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:20.766040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:20.766322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:20.766575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:20.776343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:20.777833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:20.787389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1280/2556] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:21.070654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:21.072087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:21.095208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831029e0-a61f-4c0d-bd91-ac96e909b506 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:21.099961 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:21.100693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:21.101006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:21.101281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] PATH_INFO: `/v3/projects/04eb951a8f0a4fbfbe287410a8c9f85f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:21.102418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04eb951a8f0a4fbfbe287410a8c9f85f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:21.104382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:21.153858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04eb951a8f0a4fbfbe287410a8c9f85f', 'request_id': 'req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.160184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04eb951a8f0a4fbfbe287410a8c9f85f', 'request_id': 'req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.166676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04eb951a8f0a4fbfbe287410a8c9f85f', 'request_id': 'req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.181437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] The token cache is being invalidate because project 04eb951a8f0a4fbfbe287410a8c9f85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:21.181722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.182398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.183918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1277/2557] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:21 2022] DELETE /identity/v3/projects/04eb951a8f0a4fbfbe287410a8c9f85f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:21.188072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:21.198074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e0938-1caf-4e5f-82aa-846fb13fe535 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:21.263375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:21.264008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:21.264249 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:21.264552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] PATH_INFO: `/v3/users/a4caa4d9e1f840deaa8f46fb6be3f128` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:21.265825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4caa4d9e1f840deaa8f46fb6be3f128)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:21.267794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:21.301562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:21.321307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4caa4d9e1f840deaa8f46fb6be3f128'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.328110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4caa4d9e1f840deaa8f46fb6be3f128'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.337275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4caa4d9e1f840deaa8f46fb6be3f128'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.337943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4caa4d9e1f840deaa8f46fb6be3f128'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.350668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-27c6dcc7-86b8-470f-9702-ab75f5db5729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4caa4d9e1f840deaa8f46fb6be3f128'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.356949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1281/2558] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:21 2022] DELETE /identity/v3/users/a4caa4d9e1f840deaa8f46fb6be3f128 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:21.673566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:21.681920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:21.707921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f9ee-2bc1-4369-aecd-fdbb071b0632 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:21.775533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:21.784784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:21.785642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:21.786206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:21.786796 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] PATH_INFO: `/v3/projects/b4aca6a4f4ce4620bc946734eaa45e99` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:21.788211 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4aca6a4f4ce4620bc946734eaa45e99)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:21.790523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:21.849188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4aca6a4f4ce4620bc946734eaa45e99', 'request_id': 'req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.858427 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4aca6a4f4ce4620bc946734eaa45e99', 'request_id': 'req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.865725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4aca6a4f4ce4620bc946734eaa45e99', 'request_id': 'req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.885564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] The token cache is being invalidate because project b4aca6a4f4ce4620bc946734eaa45e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:21.885897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.886630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a4f2d4ab-b2e2-4aa9-867a-b873385a6568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:21.888633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1278/2559] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:21 2022] DELETE /identity/v3/projects/b4aca6a4f4ce4620bc946734eaa45e99 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:21.893653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:21.894167 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:21.894255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:21.916721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:21.918002 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:21.978579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1282/2560] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:21.986566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:21.986851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:21.987127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.008123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:22.009667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:22.019069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1279/2561] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:22.023476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.033589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d276-5006-4ab6-a248-47f733465777 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.039077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.039699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.040190 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.040463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.041319 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:15:22.041641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.043223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.056550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1283/2562] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:15:22.060560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.071856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f462eae-b4ea-477c-a9e1-60eb684cc5e6 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.077144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.077845 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.078186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.078520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.079454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.082305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.120687 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1280/2563] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:22 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:22.121735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.131826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73ead-59ac-48ed-aff7-2f2e9205e820 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.188562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.189259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.189533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.189799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.190465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.192459 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.215959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1284/2564] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:22 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:15:22.220269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.230857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f1eea-dcaa-4517-9e64-2a12dd5205cc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.235784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.236395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.236683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.236995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.237650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.239254 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.249735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1281/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:22.253924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.264949 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765be11-cba3-4759-8d24-36632fefa396 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.271056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d6898-3077-4052-ac7c-0618f7050c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.271660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6898-3077-4052-ac7c-0618f7050c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.271933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6898-3077-4052-ac7c-0618f7050c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.272219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d6898-3077-4052-ac7c-0618f7050c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.272896 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6898-3077-4052-ac7c-0618f7050c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.274506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d6898-3077-4052-ac7c-0618f7050c1c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.286240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1285/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:22.290574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.301030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae873-3699-4a7e-a78b-9ef9049ff268 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.306197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.306843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.307122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.307392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] PATH_INFO: `/v3/projects/e15904bbdd15496baedfbd36861f33a5/users/8f6de66acd7a45089660254425830994/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.323831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15904bbdd15496baedfbd36861f33a5, user_id=8f6de66acd7a45089660254425830994, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.326549 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.341506 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1282/2567] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:22 2022] PUT /identity/v3/projects/e15904bbdd15496baedfbd36861f33a5/users/8f6de66acd7a45089660254425830994/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:22.353261 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.353597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.353849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.374956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:22.383019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] MFA Rules not processed for user `8f6de66acd7a45089660254425830994`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:22.384583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:22.449277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1286/2568] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:22.453836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.530991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b21f2-f5b0-45dc-b753-cdf05b76569e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.538139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.538852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.539186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.539439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.540127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.542100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.580091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1283/2569] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:22 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:22.581419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.593431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03c557-88a1-4c37-a437-8304b554242c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.659304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.659929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.660238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.660506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.661176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.663235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.691334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1287/2570] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:22 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:22.695664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.708102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe5c15-971e-4ce8-91a4-1b56fac4c61c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.714803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.715660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.715960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.716215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.716980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.718651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.720183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:22.733617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1284/2571] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:22.737742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.748613 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0533-c3ac-4ee9-9e91-19b4dfb9e82d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.753759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.754419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.754697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.754975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] PATH_INFO: `/v3/projects/e441ae7c16d345e4b9d101b3b9488760/users/da34783d989a4b0699dd69d28ba1194d/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.771203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e441ae7c16d345e4b9d101b3b9488760, user_id=da34783d989a4b0699dd69d28ba1194d, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.773987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.791522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1288/2572] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:22 2022] PUT /identity/v3/projects/e441ae7c16d345e4b9d101b3b9488760/users/da34783d989a4b0699dd69d28ba1194d/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:22.796857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.809909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad428b9-2658-4cd7-8d74-e677200cfd99 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.874805 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.875426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.875705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.875974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.876613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.878272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.888983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1285/2573] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:22.893625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.904841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ff94-4fd8-48e3-8f12-bc4d1435f592 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:22.910646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb8315-f675-4132-b1a7-7e9daef85307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:22.911314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8315-f675-4132-b1a7-7e9daef85307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.911713 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8315-f675-4132-b1a7-7e9daef85307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.911988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb8315-f675-4132-b1a7-7e9daef85307 admin admin] PATH_INFO: `/v3/projects/e441ae7c16d345e4b9d101b3b9488760/users/da34783d989a4b0699dd69d28ba1194d/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.914036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8315-f675-4132-b1a7-7e9daef85307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e441ae7c16d345e4b9d101b3b9488760, user_id=da34783d989a4b0699dd69d28ba1194d, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:22.916907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb8315-f675-4132-b1a7-7e9daef85307 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:22.926175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:22.927986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:22.928364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1289/2574] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:22 2022] PUT /identity/v3/projects/e441ae7c16d345e4b9d101b3b9488760/users/da34783d989a4b0699dd69d28ba1194d/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:22.939519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:22.939800 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:22.940071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:22.968618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] MFA Rules not processed for user `da34783d989a4b0699dd69d28ba1194d`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:22.970477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:22.994412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccfc3e-798f-4a01-abb1-929e964b7bc8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:23.012840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:23.040843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1290/2575] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:23.043339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:23.043949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:23.044224 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:23.044489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:23.046837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:23.052401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:23.053936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:23.116154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:23.118795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:23.124946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:23.126049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcbd94-ed75-4854-a077-723aa72bdfc0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:23.131584 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054015a3-e4c9-4a62-96e1-86c3fc9828b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:23.132246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054015a3-e4c9-4a62-96e1-86c3fc9828b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:23.132519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054015a3-e4c9-4a62-96e1-86c3fc9828b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:23.132885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054015a3-e4c9-4a62-96e1-86c3fc9828b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:23.133371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1286/2576] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:23.143142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054015a3-e4c9-4a62-96e1-86c3fc9828b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:23.144609 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054015a3-e4c9-4a62-96e1-86c3fc9828b4 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:23.154855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1291/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:15:23.303896 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:23.314155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f77c-db4f-4c51-8faa-3d628b8a3a42 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:23.319418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:23.320060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:23.320355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:23.320745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] PATH_INFO: `/v3/users/8f6de66acd7a45089660254425830994` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:23.322068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6de66acd7a45089660254425830994)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:23.324016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:23.373128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6de66acd7a45089660254425830994'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:23.388591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6de66acd7a45089660254425830994'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:23.389630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6de66acd7a45089660254425830994'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:23.390294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6de66acd7a45089660254425830994'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:23.402751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6de66acd7a45089660254425830994'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:23.418006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1287/2578] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:23 2022] DELETE /identity/v3/users/8f6de66acd7a45089660254425830994 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:23.422722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:23.423009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:23.423285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:23.442533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:23.443731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:23.510156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1292/2579] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:23.520006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:23.526247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:23.591016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7ef2-3095-42d6-9de2-6b3f38b83275 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:23.594723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:23.595353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:23.595629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:23.595899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:23.605517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:23.606949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:23.616779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1288/2580] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:23.928438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:23.930044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:23.943735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b0abf-4392-4977-bb6a-e90a82c88a60 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:23.954258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:23.955032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:23.955377 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:23.955707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] PATH_INFO: `/v3/projects/e15904bbdd15496baedfbd36861f33a5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:23.959000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15904bbdd15496baedfbd36861f33a5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:23.966981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:24.033360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15904bbdd15496baedfbd36861f33a5', 'request_id': 'req-a57b073f-aded-4934-b015-01c2b84412be'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.041776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15904bbdd15496baedfbd36861f33a5', 'request_id': 'req-a57b073f-aded-4934-b015-01c2b84412be'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.051196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15904bbdd15496baedfbd36861f33a5', 'request_id': 'req-a57b073f-aded-4934-b015-01c2b84412be'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.065503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] The token cache is being invalidate because project e15904bbdd15496baedfbd36861f33a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:24.066078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.066815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.069099 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1293/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:23 2022] DELETE /identity/v3/projects/e15904bbdd15496baedfbd36861f33a5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:24.072937 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:24.085617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940141-f17d-42b1-8b2c-afdafeca1a15 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:24.158358 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:24.159128 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:24.159475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:24.159809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] PATH_INFO: `/v3/users/da34783d989a4b0699dd69d28ba1194d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:24.161056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da34783d989a4b0699dd69d28ba1194d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:24.163546 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:24.191810 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:24.248591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da34783d989a4b0699dd69d28ba1194d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.261279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da34783d989a4b0699dd69d28ba1194d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.262121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da34783d989a4b0699dd69d28ba1194d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.262779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da34783d989a4b0699dd69d28ba1194d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.270049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1422dc72-d0a7-41bc-bf7e-3a30a9257e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da34783d989a4b0699dd69d28ba1194d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.287970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1289/2582] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:24 2022] DELETE /identity/v3/users/da34783d989a4b0699dd69d28ba1194d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:15:24.595938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:24.597430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:24.608279 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:24.612593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b073f-aded-4934-b015-01c2b84412be admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:24.683556 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:24.684368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:24.684640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:24.685046 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] PATH_INFO: `/v3/projects/e441ae7c16d345e4b9d101b3b9488760` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:24.686304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e441ae7c16d345e4b9d101b3b9488760)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:24.688253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:24.740475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e441ae7c16d345e4b9d101b3b9488760', 'request_id': 'req-946e2968-78d6-42e1-8e6e-7c49784ed175'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.747446 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e441ae7c16d345e4b9d101b3b9488760', 'request_id': 'req-946e2968-78d6-42e1-8e6e-7c49784ed175'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.756787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e441ae7c16d345e4b9d101b3b9488760', 'request_id': 'req-946e2968-78d6-42e1-8e6e-7c49784ed175'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.768400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] The token cache is being invalidate because project e441ae7c16d345e4b9d101b3b9488760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:24.768689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.769449 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-946e2968-78d6-42e1-8e6e-7c49784ed175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:24.770972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1294/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:24 2022] DELETE /identity/v3/projects/e441ae7c16d345e4b9d101b3b9488760 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:24.776960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:24.777344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:24.777537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:24.799615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:24.800742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:24.865963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1290/2584] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:24.874169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:24.874455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:24.874787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:24.901731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:24.903021 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:24.922554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1295/2585] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:15:24.923821 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:24.934283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7847be-6ab1-457a-bbdc-a35eab3fe03b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:24.939653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:24.940274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:24.940550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:24.940844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:24.941855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:15:24.941855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:24.943780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:24.956154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1291/2586] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:15:24.960322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:24.969967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a03d-5837-447f-88e8-8ad8fc8141a4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:24.975036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:24.975803 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:24.976078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:24.976347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:24.977040 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:24.979014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.010987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1296/2587] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:24 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:25.015334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.029501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d10d73-0696-460b-bb77-df7d60074e50 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.090928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.092330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.092604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.092911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.093569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.095502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.124184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1292/2588] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:25 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:25.128314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.140320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37211e0c-3546-473b-b29e-a9d35257a2dd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.146760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.147445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.147754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.147985 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.148634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.150269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.162996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1297/2589] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:15:25.166837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.178013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90f89-4835-4011-9b0b-77761b52b509 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.183085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db8a33-f1e9-464e-b28f-21ad23f9c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.183770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db8a33-f1e9-464e-b28f-21ad23f9c022 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.184045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db8a33-f1e9-464e-b28f-21ad23f9c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.184313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db8a33-f1e9-464e-b28f-21ad23f9c022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.185116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db8a33-f1e9-464e-b28f-21ad23f9c022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.186724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db8a33-f1e9-464e-b28f-21ad23f9c022 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.189148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:25.205344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1293/2590] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:25.209553 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.227847 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bba91-989f-4761-83f1-7f1f7a83f579 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.235150 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.235884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.236166 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.236440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] PATH_INFO: `/v3/projects/c9851c49f70444e59c636e9f25cf7189/users/8739b0e700a1427ead67155524affd3b/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.260987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9851c49f70444e59c636e9f25cf7189, user_id=8739b0e700a1427ead67155524affd3b, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.264656 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.285937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1298/2591] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:25 2022] PUT /identity/v3/projects/c9851c49f70444e59c636e9f25cf7189/users/8739b0e700a1427ead67155524affd3b/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:25.297972 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.298339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.298680 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.341744 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] MFA Rules not processed for user `8739b0e700a1427ead67155524affd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:25.343365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:25.416623 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1294/2592] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:25.421379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.461259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:25.492299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e8768-7c8a-48d6-8520-5cdd9f86d91e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.497824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.498573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.498906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.499181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.499902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.502006 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.542054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.542734 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1299/2593] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:25 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:25.554448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16271f73-5cd3-4003-bef3-f5342fdfeb94 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.614971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.615728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.616127 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.616399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.617115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.619074 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.641915 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1295/2594] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:25 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:25.646181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.657148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f8b3e-b3d1-4d03-9977-7c1554ea0d84 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.666504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.667681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.668170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.668659 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.669423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.671142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.684252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1300/2595] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:15:25.688391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.702461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a55c1-749b-4408-9aa0-22c4882e7cab admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.709276 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.710226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.710569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.710904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] PATH_INFO: `/v3/projects/d6e983f52cc54b7fad2f08106928f3e5/users/6cf3c5e4686c401b91f69cf4f05bd8b0/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.727962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e983f52cc54b7fad2f08106928f3e5, user_id=6cf3c5e4686c401b91f69cf4f05bd8b0, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.731475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.749893 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1296/2596] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:25 2022] PUT /identity/v3/projects/d6e983f52cc54b7fad2f08106928f3e5/users/6cf3c5e4686c401b91f69cf4f05bd8b0/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:25.754068 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.770407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17554c-befb-4c89-b806-29fd3275252f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.851201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51138001-3586-4be4-917f-a91300242a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.852408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138001-3586-4be4-917f-a91300242a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.853042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138001-3586-4be4-917f-a91300242a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.853739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138001-3586-4be4-917f-a91300242a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.854675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51138001-3586-4be4-917f-a91300242a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.856760 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51138001-3586-4be4-917f-a91300242a7e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.871105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1301/2597] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:25.877973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:25.890301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1b07d-4be4-4169-982d-341ac5d0bc9a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:25.895039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:25.895714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.895990 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.896260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] PATH_INFO: `/v3/projects/d6e983f52cc54b7fad2f08106928f3e5/users/6cf3c5e4686c401b91f69cf4f05bd8b0/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.898462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e983f52cc54b7fad2f08106928f3e5, user_id=6cf3c5e4686c401b91f69cf4f05bd8b0, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:25.901823 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:25.915628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1297/2598] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:25 2022] PUT /identity/v3/projects/d6e983f52cc54b7fad2f08106928f3e5/users/6cf3c5e4686c401b91f69cf4f05bd8b0/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:15:25.926635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:25.926924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:25.927197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:25.957092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] MFA Rules not processed for user `6cf3c5e4686c401b91f69cf4f05bd8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:25.958311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:26.047842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1302/2599] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:26.056724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:26.059295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:26.121806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:26.142212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47636a8d-efd5-404e-9e5e-55864bed3bb5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:26.146335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb47c2-b0a0-4280-947a-ebc15ab26eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:26.147382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb47c2-b0a0-4280-947a-ebc15ab26eef service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:26.147695 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb47c2-b0a0-4280-947a-ebc15ab26eef service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:26.148000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb47c2-b0a0-4280-947a-ebc15ab26eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:26.159762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb47c2-b0a0-4280-947a-ebc15ab26eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:26.161341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb47c2-b0a0-4280-947a-ebc15ab26eef service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:26.176515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1298/2600] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:26.925673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:26.967005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:27.003270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd95942-d6bd-4f2b-bc12-3abc07df9317 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:27.008547 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:27.009242 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:27.009518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:27.009788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] PATH_INFO: `/v3/users/8739b0e700a1427ead67155524affd3b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:27.010983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8739b0e700a1427ead67155524affd3b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:27.013193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:27.061185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8739b0e700a1427ead67155524affd3b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.068051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8739b0e700a1427ead67155524affd3b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.075389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8739b0e700a1427ead67155524affd3b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.076022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8739b0e700a1427ead67155524affd3b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.088753 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8739b0e700a1427ead67155524affd3b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.094770 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1303/2601] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:26 2022] DELETE /identity/v3/users/8739b0e700a1427ead67155524affd3b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:27.099332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:27.099622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:27.099898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:27.118996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:27.120567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:27.190582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1299/2602] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:27.200561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:27.202057 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:27.265247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e845f1-339e-4c28-8050-416b89e025c7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:27.269163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:27.269798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:27.270074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:27.270344 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:27.279903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:27.281402 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:27.297172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1304/2603] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:27.713639 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:27.715352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:27.728278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57050f2-0f17-43ea-b16c-b8e6d482e517 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:27.734836 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:27.735924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:27.736486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:27.736976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] PATH_INFO: `/v3/projects/c9851c49f70444e59c636e9f25cf7189` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:27.738522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9851c49f70444e59c636e9f25cf7189)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:27.741295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:27.815264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9851c49f70444e59c636e9f25cf7189', 'request_id': 'req-4187e4fa-7678-4b4e-a2de-9bc727ef8594'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.822354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9851c49f70444e59c636e9f25cf7189', 'request_id': 'req-4187e4fa-7678-4b4e-a2de-9bc727ef8594'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.830912 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9851c49f70444e59c636e9f25cf7189', 'request_id': 'req-4187e4fa-7678-4b4e-a2de-9bc727ef8594'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.846204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] The token cache is being invalidate because project c9851c49f70444e59c636e9f25cf7189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:27.846502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.847345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:27.852101 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1300/2604] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:27 2022] DELETE /identity/v3/projects/c9851c49f70444e59c636e9f25cf7189 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:27.853537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:27.866161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a96c8-e59e-4200-90bc-90b5b6223025 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:27.927296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:27.957751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:27.958403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:27.959063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:27.959546 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] PATH_INFO: `/v3/users/6cf3c5e4686c401b91f69cf4f05bd8b0` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:27.961702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf3c5e4686c401b91f69cf4f05bd8b0)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:27.963832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:28.021634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf3c5e4686c401b91f69cf4f05bd8b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.029051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf3c5e4686c401b91f69cf4f05bd8b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.038401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf3c5e4686c401b91f69cf4f05bd8b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.039093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf3c5e4686c401b91f69cf4f05bd8b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.051825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2e0d6a0b-9657-4fcb-b3b1-0103a0aef3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf3c5e4686c401b91f69cf4f05bd8b0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.058025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1305/2605] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:27 2022] DELETE /identity/v3/users/6cf3c5e4686c401b91f69cf4f05bd8b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:28.522164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:28.523660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:28.536674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187e4fa-7678-4b4e-a2de-9bc727ef8594 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:28.623049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:28.623749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:28.624024 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:28.624292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] PATH_INFO: `/v3/projects/d6e983f52cc54b7fad2f08106928f3e5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:28.625465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e983f52cc54b7fad2f08106928f3e5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:28.628752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:28.638656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:28.696975 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e983f52cc54b7fad2f08106928f3e5', 'request_id': 'req-b4932fd1-0303-428d-80af-f9be2373a823'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.707206 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e983f52cc54b7fad2f08106928f3e5', 'request_id': 'req-b4932fd1-0303-428d-80af-f9be2373a823'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.715522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e983f52cc54b7fad2f08106928f3e5', 'request_id': 'req-b4932fd1-0303-428d-80af-f9be2373a823'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.732426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] The token cache is being invalidate because project d6e983f52cc54b7fad2f08106928f3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:28.732720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.733828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b4932fd1-0303-428d-80af-f9be2373a823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:28.735875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1301/2606] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:28 2022] DELETE /identity/v3/projects/d6e983f52cc54b7fad2f08106928f3e5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:15:28.742710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:28.743282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:28.743282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:28.766554 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:28.767935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:28.832929 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1306/2607] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:28.843032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:28.843345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:28.843563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:28.864856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:28.866277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:28.876464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1302/2608] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:28.885313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:28.901750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d201-9243-476e-9f15-7e89f4506a6f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:28.907023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:28.907700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:28.907963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:28.908233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:28.908923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:15:28.909227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:28.910848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:28.924784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1307/2609] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:15:28.929373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:28.939956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89d914-c293-4c4d-bfc8-c8546df50d66 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:28.945138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:28.945750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:28.946036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:28.946304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:28.946970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:28.948969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:28.979362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1303/2610] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:28.983701 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:28.994731 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1856-47ef-42fb-b731-75e815d93ed6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:29.054732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:29.063436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:29.064081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:29.064665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:29.065211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:29.066355 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:29.068072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:29.094034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1308/2611] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:28 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:15:29.095562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:29.106107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c437c-1ff9-4c39-96a4-78a78566ac14 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:29.111057 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:29.111659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:29.111922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:29.112209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:29.112876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:29.114471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:29.125578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1304/2612] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:29.129655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:29.140620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1c58-da15-4636-81c8-25e5e4ba864e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:29.145538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccd2a1-a79b-476b-8687-efd39277912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:29.146161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd2a1-a79b-476b-8687-efd39277912b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:29.146470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd2a1-a79b-476b-8687-efd39277912b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:29.146745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd2a1-a79b-476b-8687-efd39277912b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:29.147443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccd2a1-a79b-476b-8687-efd39277912b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:29.149084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccd2a1-a79b-476b-8687-efd39277912b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:29.160450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1309/2613] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:29.167136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:29.188642 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c0005-aaa6-4024-85b7-9fa6800a6d9c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:29.194000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:29.194682 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:29.194958 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:29.195226 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] PATH_INFO: `/v3/projects/dabfc0b39bf942b485b2a95a526b72df/users/ce5a80d796234e179fbf91cf8e139aa8/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:29.212268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabfc0b39bf942b485b2a95a526b72df, user_id=ce5a80d796234e179fbf91cf8e139aa8, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:29.213522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:29.228794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1305/2614] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:29 2022] PUT /identity/v3/projects/dabfc0b39bf942b485b2a95a526b72df/users/ce5a80d796234e179fbf91cf8e139aa8/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:29.239394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:29.239683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:29.239957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:29.272500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] MFA Rules not processed for user `ce5a80d796234e179fbf91cf8e139aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:29.273729 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:29.351253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1310/2615] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:29.364096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:29.366058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:29.429944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916580e-4223-43a5-93f4-39b92353fa85 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:29.433709 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:29.434326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:29.434605 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:29.434878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:29.443399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:29.444933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:29.454184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1306/2616] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:30.098224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:30.100549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:30.184296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:30.188654 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:30.208410 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed9846-b5e3-4167-a7d7-dc2317458b53 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:30.217897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:30.218530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:30.218861 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:30.219244 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:30.221113 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:30.233238 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:30.234833 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:30.244184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:30.245795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1311/2617] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:30.275305 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7efd2-1d8b-4ac9-a631-14a804897f28 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:30.284352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:30.285063 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:30.285465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:30.285747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] PATH_INFO: `/v3/users/c7d17a5a96a74c3e903f08b41eb080fa` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:30.286900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d17a5a96a74c3e903f08b41eb080fa)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:30.288944 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:30.337289 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d17a5a96a74c3e903f08b41eb080fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.353541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d17a5a96a74c3e903f08b41eb080fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.354374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d17a5a96a74c3e903f08b41eb080fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.354993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d17a5a96a74c3e903f08b41eb080fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.362497 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d17a5a96a74c3e903f08b41eb080fa'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.377094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1307/2618] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:30 2022] DELETE /identity/v3/users/c7d17a5a96a74c3e903f08b41eb080fa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:30.560962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:30.572963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2d27e-848e-4c34-8ebb-a0cbc45d0ae1 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:30.640670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:30.650223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:30.650855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:30.651144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:30.651411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] PATH_INFO: `/v3/projects/dc058da67d7842f6b723e4bd22d47086` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:30.652523 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc058da67d7842f6b723e4bd22d47086)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:30.654558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:30.700492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc058da67d7842f6b723e4bd22d47086', 'request_id': 'req-9002062f-bb5d-474e-be1c-98e2ffb98f76'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.706263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc058da67d7842f6b723e4bd22d47086', 'request_id': 'req-9002062f-bb5d-474e-be1c-98e2ffb98f76'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.717999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc058da67d7842f6b723e4bd22d47086', 'request_id': 'req-9002062f-bb5d-474e-be1c-98e2ffb98f76'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.729289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] The token cache is being invalidate because project dc058da67d7842f6b723e4bd22d47086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:30.729571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.730184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.731669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1312/2619] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:30 2022] DELETE /identity/v3/projects/dc058da67d7842f6b723e4bd22d47086 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:15:30.736333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:30.737850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:30.752556 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cf716-bdb2-4401-8e08-89ac5046e429 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:30.822091 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:30.822622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:30.822897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:30.823193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] PATH_INFO: `/v3/users/0bf245f363fc4150880e29c14a8b269c` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:30.824326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf245f363fc4150880e29c14a8b269c)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:30.826284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:30.882382 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf245f363fc4150880e29c14a8b269c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.889745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:30.895621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf245f363fc4150880e29c14a8b269c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.896355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf245f363fc4150880e29c14a8b269c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.897667 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf245f363fc4150880e29c14a8b269c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.913323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf245f363fc4150880e29c14a8b269c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:30.927825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1308/2620] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:30 2022] DELETE /identity/v3/users/0bf245f363fc4150880e29c14a8b269c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:31.129705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:31.131274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:31.146767 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002062f-bb5d-474e-be1c-98e2ffb98f76 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:31.203981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:31.204612 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:31.204919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:31.205187 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] PATH_INFO: `/v3/projects/9cb79ea15c6948139548df3d4c3af916` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:31.206289 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb79ea15c6948139548df3d4c3af916)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:31.208184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:31.258684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb79ea15c6948139548df3d4c3af916', 'request_id': 'req-00e48a72-5f75-4889-913b-72ed4d98af69'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:31.264458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb79ea15c6948139548df3d4c3af916', 'request_id': 'req-00e48a72-5f75-4889-913b-72ed4d98af69'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:31.274475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb79ea15c6948139548df3d4c3af916', 'request_id': 'req-00e48a72-5f75-4889-913b-72ed4d98af69'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:31.287663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] The token cache is being invalidate because project 9cb79ea15c6948139548df3d4c3af916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:31.287946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:31.288727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-00e48a72-5f75-4889-913b-72ed4d98af69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:31.290361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1313/2621] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:31 2022] DELETE /identity/v3/projects/9cb79ea15c6948139548df3d4c3af916 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:36.001690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:36.003414 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:36.017228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686f5c6-7107-4aac-8291-e020da09520f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:36.079117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:36.079757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.080037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.080311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] PATH_INFO: `/v3/users/ce5a80d796234e179fbf91cf8e139aa8` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.081552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5a80d796234e179fbf91cf8e139aa8)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:36.083533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:36.132208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5a80d796234e179fbf91cf8e139aa8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.144686 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5a80d796234e179fbf91cf8e139aa8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.145422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5a80d796234e179fbf91cf8e139aa8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.146058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5a80d796234e179fbf91cf8e139aa8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.153143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5a80d796234e179fbf91cf8e139aa8'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.166619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1309/2622] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:15:36 2022] DELETE /identity/v3/users/ce5a80d796234e179fbf91cf8e139aa8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:36.171154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.171635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.171736 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.190619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:36.191838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:36.200309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:36.254842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1314/2623] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:36.265183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:36.266708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:36.323109 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca4453-644f-4902-96f7-c718472fa9a9 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:36.327658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef73ba-9832-45cc-9673-795989a38077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:36.328261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef73ba-9832-45cc-9673-795989a38077 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.328568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef73ba-9832-45cc-9673-795989a38077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.328918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef73ba-9832-45cc-9673-795989a38077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.338461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:36.342342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef73ba-9832-45cc-9673-795989a38077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:36.345481 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef73ba-9832-45cc-9673-795989a38077 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:36.359474 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1310/2624] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:36.627214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:36.628849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:36.641697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8aecca-f19f-4ce1-89e5-80e1d583d2df None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:36.646725 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:36.647345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.647639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.647940 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] PATH_INFO: `/v3/projects/dabfc0b39bf942b485b2a95a526b72df` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.649212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabfc0b39bf942b485b2a95a526b72df)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:36.651233 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:36.701121 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabfc0b39bf942b485b2a95a526b72df', 'request_id': 'req-9a22abfb-ebe0-43da-bd28-60bc28eb0593'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.706828 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabfc0b39bf942b485b2a95a526b72df', 'request_id': 'req-9a22abfb-ebe0-43da-bd28-60bc28eb0593'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.716630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabfc0b39bf942b485b2a95a526b72df', 'request_id': 'req-9a22abfb-ebe0-43da-bd28-60bc28eb0593'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.728007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] The token cache is being invalidate because project dabfc0b39bf942b485b2a95a526b72df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:15:36.728292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.728971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9a22abfb-ebe0-43da-bd28-60bc28eb0593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:15:36.730486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1315/2625] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:15:36 2022] DELETE /identity/v3/projects/dabfc0b39bf942b485b2a95a526b72df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:15:36.736624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206521-7d49-4022-a027-1345e26de892 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.736936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206521-7d49-4022-a027-1345e26de892 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.737217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206521-7d49-4022-a027-1345e26de892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.757921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-aa206521-7d49-4022-a027-1345e26de892 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:36.759120 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-aa206521-7d49-4022-a027-1345e26de892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:36.820688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1311/2626] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:36.828501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.828778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.829077 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.849074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:36.850272 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:36.859296 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1316/2627] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:36.863448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206521-7d49-4022-a027-1345e26de892 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:36.873831 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa206521-7d49-4022-a027-1345e26de892 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:36.879440 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:36.880044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.880326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.880600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.881292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:15:36.881624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:36.883253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:36.895360 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1312/2628] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:15:36.899501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:36.911649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307c20e-8e5d-4080-bea9-28d0e5642108 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:36.918004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:36.918607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:36.918879 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:36.919158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:36.919798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:36.921823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:36.958055 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1317/2629] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:15:36 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:36.959555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:36.969834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1cb7-b8dd-42e4-8e2e-b3048668b113 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:37.047114 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:37.048058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:37.048058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:37.048762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:37.049055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:37.050895 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:37.074674 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1313/2630] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:15:36 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:15:37.079607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:37.096773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d24f-bb65-4d75-80fe-1cb24abbdf5c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:37.104777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:37.105435 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:37.105710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:37.105988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:37.106650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:37.108263 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:37.118802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1318/2631] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:37.123126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:37.133596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9dd9f-38a3-4109-83ea-b7ac10b2f8e4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:37.139175 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f4fac-d91f-40a6-a647-cf57127a1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:37.139779 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f4fac-d91f-40a6-a647-cf57127a1d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:37.140187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f4fac-d91f-40a6-a647-cf57127a1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:37.140458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f4fac-d91f-40a6-a647-cf57127a1d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:37.141139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f4fac-d91f-40a6-a647-cf57127a1d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:37.142766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f4fac-d91f-40a6-a647-cf57127a1d4a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:37.153804 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1314/2632] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:15:37.157982 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:37.168301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1caef-57f1-4731-ab19-32e2eb4bd4c6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:37.173275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:37.173909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:37.174218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:37.174491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] PATH_INFO: `/v3/projects/afa1dd9e49b5438193247b512cf67506/users/b387a3c100e8464991c0961caef3f1b5/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:37.189788 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa1dd9e49b5438193247b512cf67506, user_id=b387a3c100e8464991c0961caef3f1b5, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:37.192445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:37.208358 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1319/2633] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:15:37 2022] PUT /identity/v3/projects/afa1dd9e49b5438193247b512cf67506/users/b387a3c100e8464991c0961caef3f1b5/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:15:37.221314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b4e53-911b-4eec-9f1c-fad269f96d53 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:37.221592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b4e53-911b-4eec-9f1c-fad269f96d53 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:37.221849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b4e53-911b-4eec-9f1c-fad269f96d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:37.251281 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0b3b4e53-911b-4eec-9f1c-fad269f96d53 None None] MFA Rules not processed for user `b387a3c100e8464991c0961caef3f1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:37.252502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0b3b4e53-911b-4eec-9f1c-fad269f96d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:37.301363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:37.320121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1315/2634] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:15:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:37.332044 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:37.334081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:37.373988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:15:37.398561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4022b13-1b6c-462c-8174-628f59d7c0c5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:37.402486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e43f4bd3ff65424eb02b4261d3c3d700', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:37.403132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:37.403407 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:37.403674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:37.412158 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:37.413587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:37.422231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1320/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:44.371363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93063ad-d684-40a1-a2d3-bacd6adda57c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:44.372279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93063ad-d684-40a1-a2d3-bacd6adda57c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:44.372279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93063ad-d684-40a1-a2d3-bacd6adda57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:44.399707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f93063ad-d684-40a1-a2d3-bacd6adda57c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:44.401079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f93063ad-d684-40a1-a2d3-bacd6adda57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:44.465267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1316/2636] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:44.497212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:44.498936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:44.578743 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b96b8-5cc9-4c9f-8c59-99feef8da3dd service glance] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:44.586350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:44.586966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:44.587241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:44.587511 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:44.596385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:44.598130 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:44.608008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1321/2637] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:48.479662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12c91-1495-4dcc-a69a-cf03efc491be None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:48.480138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12c91-1495-4dcc-a69a-cf03efc491be None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:48.480138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12c91-1495-4dcc-a69a-cf03efc491be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:48.501219 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a3a12c91-1495-4dcc-a69a-cf03efc491be None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:48.502453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a3a12c91-1495-4dcc-a69a-cf03efc491be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:48.511030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1317/2638] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:48.534999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:48.536618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:48.552009 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f13779-5065-4fb5-b9c2-7dcf552a604e service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:48.558058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:48.558684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:48.558957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:48.559492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:48.568907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:48.570512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:48.581270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1322/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:52.816216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535ef4-b408-4d53-8b96-f5048e23aca8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:52.816855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535ef4-b408-4d53-8b96-f5048e23aca8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:52.816855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535ef4-b408-4d53-8b96-f5048e23aca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:52.837700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-e7535ef4-b408-4d53-8b96-f5048e23aca8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:52.838884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-e7535ef4-b408-4d53-8b96-f5048e23aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:52.848069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1318/2640] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:52.874125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:52.885796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d75309-43a6-4489-89b5-4d55d983d8e8 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:52.893210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:52.893791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:52.894066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:52.894333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:52.904058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:52.905727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:52.915804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1323/2641] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:15:56.975510 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b5107-48f5-45cb-8843-69fa7e99cf9e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:56.976333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b5107-48f5-45cb-8843-69fa7e99cf9e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:56.976511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b5107-48f5-45cb-8843-69fa7e99cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:57.012006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-9b8b5107-48f5-45cb-8843-69fa7e99cf9e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:15:57.013243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9b8b5107-48f5-45cb-8843-69fa7e99cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:15:57.022716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1319/2642] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:15:57.046745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:15:57.057917 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1545e1-894a-4d4b-9644-4362d7ce915e service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:15:57.065569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:15:57.066648 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:15:57.067506 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:15:57.067991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:15:57.078937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:15:57.080685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:15:57.093003 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1324/2643] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:01.167490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165720ce-6e04-450d-9a5f-49b8a543c60b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:01.168283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165720ce-6e04-450d-9a5f-49b8a543c60b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:01.168447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165720ce-6e04-450d-9a5f-49b8a543c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:01.197555 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-165720ce-6e04-450d-9a5f-49b8a543c60b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:01.198811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-165720ce-6e04-450d-9a5f-49b8a543c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:01.207731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1320/2644] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:01.233086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:01.245287 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302a36e-e246-4d4a-b3d6-db3bb39abc85 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:01.252134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:01.252732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:01.253047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:01.253313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:01.261754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:01.263351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:01.272902 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1325/2645] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:05.365746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:05.366255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:05.366255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:05.388752 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:05.390153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:05.398887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1321/2646] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:05.423512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:05.435844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dc39c-6527-4543-bafe-aabdd5a73eec service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:05.441986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03661aed-3fd7-414f-a8c1-4f8a3ecca1d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:05.442754 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661aed-3fd7-414f-a8c1-4f8a3ecca1d1 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:05.443038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661aed-3fd7-414f-a8c1-4f8a3ecca1d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:05.443318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661aed-3fd7-414f-a8c1-4f8a3ecca1d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:05.453145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03661aed-3fd7-414f-a8c1-4f8a3ecca1d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:05.455198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03661aed-3fd7-414f-a8c1-4f8a3ecca1d1 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:05.465881 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1326/2647] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:09.922732 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:09.929966 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=47 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:09.939819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e4bec-6f98-4e25-bf05-46d3532b42d3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:09.947501 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:09.948136 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:09.948411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:09.948683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] PATH_INFO: `/v3/users/b387a3c100e8464991c0961caef3f1b5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:09.949932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b387a3c100e8464991c0961caef3f1b5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:09.951885 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:10.014303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b387a3c100e8464991c0961caef3f1b5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.028925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b387a3c100e8464991c0961caef3f1b5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.029923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b387a3c100e8464991c0961caef3f1b5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.030951 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b387a3c100e8464991c0961caef3f1b5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.039948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b387a3c100e8464991c0961caef3f1b5'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.056476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1322/2648] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:16:09 2022] DELETE /identity/v3/users/b387a3c100e8464991c0961caef3f1b5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:10.062851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:10.063384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:10.063384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:10.070532 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=76 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:10.086775 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:10.088091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:10.162170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1327/2649] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:10.172239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:10.173894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:10.244691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674e15-90ad-4808-8953-a5df4faa50d1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:10.250039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:10.250703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:10.250981 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:10.251248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:10.262725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:10.264163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:10.274792 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1323/2650] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:10.561030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:10.562620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:10.577663 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49e661-1792-4d0b-b4d9-6704ccd330de None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:10.582809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:10.583534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:10.584510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:10.584792 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] PATH_INFO: `/v3/projects/afa1dd9e49b5438193247b512cf67506` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:10.586194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa1dd9e49b5438193247b512cf67506)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:10.588222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:10.637998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa1dd9e49b5438193247b512cf67506', 'request_id': 'req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.643906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa1dd9e49b5438193247b512cf67506', 'request_id': 'req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.653270 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa1dd9e49b5438193247b512cf67506', 'request_id': 'req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.665845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] The token cache is being invalidate because project afa1dd9e49b5438193247b512cf67506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:16:10.666107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.666915 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1d8f42c-d097-4bea-ad71-f8c0e7a96ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:10.668536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1328/2651] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:16:10 2022] DELETE /identity/v3/projects/afa1dd9e49b5438193247b512cf67506 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:20.269916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:20.662000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:22.284037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:22.293447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac2c1-e0ab-4e5f-907c-a75472f2f465 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:22.345866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:22.346953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:22.346953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:22.347253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:22.349210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:22.421736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:22.423179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:22.433085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1324/2652] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:22.974686 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:22.975253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:22.975393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:22.995582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] MFA Rules not processed for user `00133c444368459eba906d2349488922`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:22.996826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:23.052904 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1329/2653] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:26.166299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:26.168218 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:26.181331 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f767a4-d9a2-4a82-a49e-97e0db6799a9 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:26.186708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:26.187470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:26.187809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:26.188141 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] PATH_INFO: `/v3/users/45de14fdfb4347918b93e8871d718043` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:26.189361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45de14fdfb4347918b93e8871d718043)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:26.191443 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:26.242923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45de14fdfb4347918b93e8871d718043'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.257048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45de14fdfb4347918b93e8871d718043'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.257745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45de14fdfb4347918b93e8871d718043'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.258342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45de14fdfb4347918b93e8871d718043'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.265630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-a64faef3-bedc-4e9c-ab57-96a28278cab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45de14fdfb4347918b93e8871d718043'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.280208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1325/2654] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:16:26 2022] DELETE /identity/v3/users/45de14fdfb4347918b93e8871d718043 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:26.589472 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:26.600930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d096-2149-444f-9300-c8ae6603b315 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:26.669776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:26.670429 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:26.670714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:26.671012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] PATH_INFO: `/v3/projects/2adf2839135346ecb3915016289d7b82` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:26.672180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adf2839135346ecb3915016289d7b82)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:26.674152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:26.727066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adf2839135346ecb3915016289d7b82', 'request_id': 'req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.732987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adf2839135346ecb3915016289d7b82', 'request_id': 'req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.742381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adf2839135346ecb3915016289d7b82', 'request_id': 'req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.754414 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] The token cache is being invalidate because project 2adf2839135346ecb3915016289d7b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:16:26.754700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.755327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d9b601c8-8e12-4a41-a5ee-3de75759dc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:26.756858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1330/2655] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:16:26 2022] DELETE /identity/v3/projects/2adf2839135346ecb3915016289d7b82 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:26.761807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:26.762096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:26.762374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:26.781852 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:26.783068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:26.800439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:26.850611 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1326/2656] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:26.859176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:26.859460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:26.859730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:26.885935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:26.887118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:26.905142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1331/2657] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:26.909719 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:26.920122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff011a-ed35-434e-bf5b-707a0eed29ea None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:26.925147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:26.925788 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:26.926070 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:26.926348 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:26.927171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:16:26.927511 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:26.929231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:26.944965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1327/2658] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:16:26.946443 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:26.956031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b35c-8498-4b8e-bc9b-5d62d0d0623f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:26.960956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:26.961756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:26.962123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:26.962456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:26.963128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:26.965125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:26.994074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1332/2659] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:16:26 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:26.998629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.009112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59886b-d53a-47a5-9c8c-d344688c2a29 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.066252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.066873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.067143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.067410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.068073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.070142 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.093717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1328/2660] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:16:26 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:27.097878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.108201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27637fb7-3df7-4d33-91f4-a522c2943bc2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.113223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.113831 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.114137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.114409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.115052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.116890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.118381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:27.132176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1333/2661] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:27.136354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.146519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fc29f-11f9-4bde-aaf7-7190f3edf172 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.151500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424356-2a2a-400e-a08e-85f690df2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.152121 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424356-2a2a-400e-a08e-85f690df2f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.152399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424356-2a2a-400e-a08e-85f690df2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.152664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424356-2a2a-400e-a08e-85f690df2f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.153361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424356-2a2a-400e-a08e-85f690df2f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.154950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69424356-2a2a-400e-a08e-85f690df2f5c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.166132 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1329/2662] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:16:27.170450 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.181060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeca39e-2544-420d-9165-5eb7f330c0aa admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.185645 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.186309 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.186585 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.186851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] PATH_INFO: `/v3/projects/e0dd1de2111d40d1b45a558db67c055b/users/59b345b89db449758eadd91155aec51d/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.207305 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0dd1de2111d40d1b45a558db67c055b, user_id=59b345b89db449758eadd91155aec51d, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.210721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.226996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1334/2663] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:27 2022] PUT /identity/v3/projects/e0dd1de2111d40d1b45a558db67c055b/users/59b345b89db449758eadd91155aec51d/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:16:27.237886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.238401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.238637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.270135 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] MFA Rules not processed for user `59b345b89db449758eadd91155aec51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:27.271350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:27.477107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1330/2664] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:27.481913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.548704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40a4a4-891f-4d05-8405-2aef69418482 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.555696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.556368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.556757 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.557058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.557710 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.559627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.587776 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1335/2665] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:27.592002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.602754 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09dfa7-a701-4595-92d7-f30e4adfcc52 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.615320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:27.678298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.678962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.679223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.679485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.680104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.682371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.709684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1331/2666] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:16:27 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:27.713867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.726735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ababc-bad6-46af-955c-2cb73eb46857 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.731413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.732059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.732363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.732630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.733346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.734962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.748837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1336/2667] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:16:27.751240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.761691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead1aeb-55a8-4d38-910b-259f5ddf9dcf admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.766712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.767347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.767621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.767884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] PATH_INFO: `/v3/projects/715e92b1f1f140308b64a0640bb819e5/users/2993788dab5a4cf097ed58e94f4806a8/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.782760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715e92b1f1f140308b64a0640bb819e5, user_id=2993788dab5a4cf097ed58e94f4806a8, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.785399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.799787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1332/2668] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:27 2022] PUT /identity/v3/projects/715e92b1f1f140308b64a0640bb819e5/users/2993788dab5a4cf097ed58e94f4806a8/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:27.804141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.814430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b2061-4da1-4f8b-a2a8-7264491d8cb5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.869845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e6c80-011f-4d53-986d-bc010961b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.870445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e6c80-011f-4d53-986d-bc010961b809 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.870707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e6c80-011f-4d53-986d-bc010961b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.870976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e6c80-011f-4d53-986d-bc010961b809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.871601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e6c80-011f-4d53-986d-bc010961b809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.873210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e6c80-011f-4d53-986d-bc010961b809 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.882798 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1337/2669] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:27.888707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:27.899485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2c714-0634-4403-9a24-7c13ea6f4e31 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:27.904144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:27.904780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.905071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.905335 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] PATH_INFO: `/v3/projects/715e92b1f1f140308b64a0640bb819e5/users/2993788dab5a4cf097ed58e94f4806a8/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.907240 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=715e92b1f1f140308b64a0640bb819e5, user_id=2993788dab5a4cf097ed58e94f4806a8, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:27.909861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:27.920902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1333/2670] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:27 2022] PUT /identity/v3/projects/715e92b1f1f140308b64a0640bb819e5/users/2993788dab5a4cf097ed58e94f4806a8/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:16:27.932837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:27.933126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:27.933400 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:27.961610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] MFA Rules not processed for user `2993788dab5a4cf097ed58e94f4806a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:27.962837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:27.992545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:28.036721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1338/2671] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:28.048152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:28.049936 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:28.108093 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411d398-6078-45d8-95bb-360b4fdbb98f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:28.112017 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:28.112628 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:28.112935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:28.113208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:28.122837 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:28.124266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:28.133874 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1334/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:28.217072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:28.227948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c5355-081d-474c-a22c-0441bc116ba4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:28.231598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:28.232203 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:28.232474 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:28.232742 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:28.294983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:28.296441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:28.305821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1339/2673] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:32.419359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:32.421379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:32.485722 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb245c09-e057-447d-b59e-79178379b2aa service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:32.489435 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:32.490119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:32.490392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:32.490907 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:32.492859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:32.523353 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:32.586340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:32.588139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5987876-26ff-4851-9e4d-ac003867a5a5 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:32.603469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1335/2674] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:35.155066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:35.165160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cecb3-1c8a-4ae5-a266-17488464339f service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:35.169471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:35.170124 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:35.170395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:35.170664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:35.172605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:35.186610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:35.188037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:35.199050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1340/2675] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:41.501006 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782eff-87b3-46e9-aeb3-8b1735e9e385 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:41.501643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782eff-87b3-46e9-aeb3-8b1735e9e385 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:41.502670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9782eff-87b3-46e9-aeb3-8b1735e9e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:41.529376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-b9782eff-87b3-46e9-aeb3-8b1735e9e385 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:41.531039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b9782eff-87b3-46e9-aeb3-8b1735e9e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:41.596920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1336/2676] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:41.626928 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:41.628349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:41.644758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319da1-9b40-458b-a73c-91a8fdadc71e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:41.650697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:41.651430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:41.651766 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:41.652106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:41.660605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:41.662340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:41.671966 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1341/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:44.660830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746cf3-db3c-4d1c-b13b-e6982172409e None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:44.661394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746cf3-db3c-4d1c-b13b-e6982172409e None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:44.661394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746cf3-db3c-4d1c-b13b-e6982172409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:44.683184 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2d746cf3-db3c-4d1c-b13b-e6982172409e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:44.684389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2d746cf3-db3c-4d1c-b13b-e6982172409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:44.694143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1337/2678] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:44.715718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:44.717295 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:44.732957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8770-b032-4b0e-953e-1d953ed53cff service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:44.740669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:44.741689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:44.741791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:44.742004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:44.751899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:44.753575 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:44.764269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1342/2679] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:47.711873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad766283-308a-4933-a5ab-722262071185 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:47.712359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad766283-308a-4933-a5ab-722262071185 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:47.712359 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad766283-308a-4933-a5ab-722262071185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:47.733460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ad766283-308a-4933-a5ab-722262071185 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:47.734984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ad766283-308a-4933-a5ab-722262071185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:47.745790 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1338/2680] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:47.778698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:47.790976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b32c2-9c8f-4cfe-bc77-6f3977c53a5a service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:47.797963 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cc57d-973e-4684-9544-c7b233af186d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:47.798768 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc57d-973e-4684-9544-c7b233af186d service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:47.799097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc57d-973e-4684-9544-c7b233af186d service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:47.799438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc57d-973e-4684-9544-c7b233af186d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:47.809347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cc57d-973e-4684-9544-c7b233af186d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:47.811011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cc57d-973e-4684-9544-c7b233af186d service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:47.821839 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1343/2681] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:49.173144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad766283-308a-4933-a5ab-722262071185 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:49.174700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ad766283-308a-4933-a5ab-722262071185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:49.187630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad766283-308a-4933-a5ab-722262071185 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:49.191542 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:49.192283 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:49.192492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:49.192834 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:49.194712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:49.206947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:49.208486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:49.218021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1339/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:50.901650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:50.902524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:50.902961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:50.932022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:50.933482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:50.942602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1344/2683] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:50.970954 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:50.995679 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f6e05-2d86-45ce-853d-deb23c472cfa service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:51.004293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:51.005243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:51.005737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:51.006244 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:51.016157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:51.018178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:51.029858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1340/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:52.509772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:52.511739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:52.528108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919c0d-2f3d-4ae9-921e-e156ed46166d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:52.533334 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:52.534264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:52.534606 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:52.534968 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] PATH_INFO: `/v3/users/a3a98eacfbcd4825bf62913759682a01` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:52.550269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a98eacfbcd4825bf62913759682a01)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:52.552275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:52.611629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a98eacfbcd4825bf62913759682a01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.621437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:52.622958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a98eacfbcd4825bf62913759682a01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.633468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a98eacfbcd4825bf62913759682a01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.634453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a98eacfbcd4825bf62913759682a01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.652705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cdc4b1a3-ffae-4c22-9fcb-70829250432c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a98eacfbcd4825bf62913759682a01'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.663919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1345/2685] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:16:52 2022] DELETE /identity/v3/users/a3a98eacfbcd4825bf62913759682a01 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:52.846550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:52.859684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022493a-9144-4cb3-a667-763323b93d1e service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:52.918986 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:52.919547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:52.919825 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:52.920096 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] PATH_INFO: `/v3/projects/920d496d52e44246ad9a9a31a3c9062b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:52.930484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920d496d52e44246ad9a9a31a3c9062b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:52.932393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:52.940572 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:52.980544 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920d496d52e44246ad9a9a31a3c9062b', 'request_id': 'req-4ad3fe05-b592-45f8-bbff-b17b57d04547'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.987153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920d496d52e44246ad9a9a31a3c9062b', 'request_id': 'req-4ad3fe05-b592-45f8-bbff-b17b57d04547'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:52.992475 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920d496d52e44246ad9a9a31a3c9062b', 'request_id': 'req-4ad3fe05-b592-45f8-bbff-b17b57d04547'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:53.005632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] The token cache is being invalidate because project 920d496d52e44246ad9a9a31a3c9062b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:16:53.005914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:53.006517 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-4ad3fe05-b592-45f8-bbff-b17b57d04547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:53.008021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1341/2686] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:16:52 2022] DELETE /identity/v3/projects/920d496d52e44246ad9a9a31a3c9062b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:53.013201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.013484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.013758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.034555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:53.035786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:53.097423 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1346/2687] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:53.105058 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.105493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.106168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.128295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:53.129791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:53.138455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1342/2688] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:53.142823 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.153171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa85d0e-4b87-4d1e-83c8-fe0610ecd75e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.158060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.158666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.158977 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.159225 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.159872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:16:53.160175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.161796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.174863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1347/2689] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:16:53.179317 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.188523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58eebd-58e3-4cfd-a107-21ea4c01d5e3 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.193176 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.193780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.194163 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.194422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.195118 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.197052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.238089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1343/2690] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:16:53 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:53.242835 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.253403 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60720ed8-3dd6-4cf9-92e4-5fdee8e32f19 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.312314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.312969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.313292 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.313552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.314196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.316123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.338165 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1348/2691] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:16:53 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:16:53.342688 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.353901 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab971-7ac6-431f-ac4f-a5e62f842483 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.359277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.359897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.360174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.360480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.361157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.362859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.373272 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1344/2692] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:53.377375 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.387820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc771-6d69-4bf6-85b4-8557b425bf1e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.393781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb10845-3a1f-4f4f-ae94-74905a68ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.394384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10845-3a1f-4f4f-ae94-74905a68ae12 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.394664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10845-3a1f-4f4f-ae94-74905a68ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.394930 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10845-3a1f-4f4f-ae94-74905a68ae12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.395570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb10845-3a1f-4f4f-ae94-74905a68ae12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.397232 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb10845-3a1f-4f4f-ae94-74905a68ae12 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.408180 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1349/2693] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:16:53.412327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.422778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f46a4-7841-4591-8b51-34583eb20bde admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.428737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.429371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.429649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.429919 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] PATH_INFO: `/v3/projects/77d346c8c35b4f348f990e2113859253/users/ac2f218c7d9c41eba4a2dfee6cadfbd7/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.446102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d346c8c35b4f348f990e2113859253, user_id=ac2f218c7d9c41eba4a2dfee6cadfbd7, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.448771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.465312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1345/2694] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:53 2022] PUT /identity/v3/projects/77d346c8c35b4f348f990e2113859253/users/ac2f218c7d9c41eba4a2dfee6cadfbd7/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:53.476716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b1c6-932e-47d4-a5e7-3c137dfc0c10 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.477173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b1c6-932e-47d4-a5e7-3c137dfc0c10 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.477552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b1c6-932e-47d4-a5e7-3c137dfc0c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.513498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8df5b1c6-932e-47d4-a5e7-3c137dfc0c10 None None] MFA Rules not processed for user `ac2f218c7d9c41eba4a2dfee6cadfbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:53.514716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8df5b1c6-932e-47d4-a5e7-3c137dfc0c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:53.537389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:53.588397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1350/2695] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:53.601081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:53.602970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:53.683922 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38af93b-7132-47c0-9739-0520b6cb1e15 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:53.690038 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:53.690647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:53.690920 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:53.691188 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:53.699567 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:53.701285 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:53.713311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1346/2696] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:55.167844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:55.169863 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:55.170173 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:55.194001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:55.195437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:55.271937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1351/2697] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Aug 31 04:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:55.296350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:55.297791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:55.314167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6eb3e-a8a3-4b1a-b365-8956026dbb17 service nova] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:55.319987 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d26861-ab10-4abf-b2af-05cdbbd268fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d3488259a0490bb05a0c49688f5957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:55.320701 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d26861-ab10-4abf-b2af-05cdbbd268fa service nova] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:55.321108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d26861-ab10-4abf-b2af-05cdbbd268fa service nova] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:55.321592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d26861-ab10-4abf-b2af-05cdbbd268fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:55.328851 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:55.331284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d26861-ab10-4abf-b2af-05cdbbd268fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:55.345904 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d26861-ab10-4abf-b2af-05cdbbd268fa service nova] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:55.361001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1347/2698] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:56.478007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:56.487993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857f65-ada6-45fa-a0ee-fe55469438d8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:56.496208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:56.496888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:56.497237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:56.497512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] PATH_INFO: `/v3/users/ac2f218c7d9c41eba4a2dfee6cadfbd7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:56.498651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2f218c7d9c41eba4a2dfee6cadfbd7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:56.500694 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:56.549299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2f218c7d9c41eba4a2dfee6cadfbd7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:56.557522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2f218c7d9c41eba4a2dfee6cadfbd7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:56.566494 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2f218c7d9c41eba4a2dfee6cadfbd7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:56.567226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2f218c7d9c41eba4a2dfee6cadfbd7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:56.581737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2f218c7d9c41eba4a2dfee6cadfbd7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:56.591797 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1352/2699] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:16:56 2022] DELETE /identity/v3/users/ac2f218c7d9c41eba4a2dfee6cadfbd7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:56.596325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:56.596819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:56.596948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:56.616174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:56.617432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:56.678233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1348/2700] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:56.688851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:56.690380 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:56.741784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:56.765976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15836104-a900-4902-a43b-8b7ce915d85f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:56.771965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285148c-94af-41f1-8a50-ddb9870cf9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:56.773110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285148c-94af-41f1-8a50-ddb9870cf9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:56.773447 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285148c-94af-41f1-8a50-ddb9870cf9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:56.774144 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285148c-94af-41f1-8a50-ddb9870cf9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:56.785499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285148c-94af-41f1-8a50-ddb9870cf9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:56.787325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285148c-94af-41f1-8a50-ddb9870cf9c1 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:56.798551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1353/2701] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:57.092055 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.093685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:57.107646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003ed08-5b48-407d-a7eb-97685a452a26 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.113119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.113778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.114050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.114340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] PATH_INFO: `/v3/projects/77d346c8c35b4f348f990e2113859253` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.115665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d346c8c35b4f348f990e2113859253)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.117633 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.167604 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d346c8c35b4f348f990e2113859253', 'request_id': 'req-834092d5-5163-4f9b-ae8f-247080b355db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:57.174284 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d346c8c35b4f348f990e2113859253', 'request_id': 'req-834092d5-5163-4f9b-ae8f-247080b355db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:57.179877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d346c8c35b4f348f990e2113859253', 'request_id': 'req-834092d5-5163-4f9b-ae8f-247080b355db'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:57.193539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] The token cache is being invalidate because project 77d346c8c35b4f348f990e2113859253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:16:57.193828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:57.194454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-834092d5-5163-4f9b-ae8f-247080b355db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:57.195953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1349/2702] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:16:57 2022] DELETE /identity/v3/projects/77d346c8c35b4f348f990e2113859253 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:57.201014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.201325 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.201596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.221504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:57.222604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:57.287126 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1354/2703] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:16:57.297362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.297756 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.298099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.319338 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:57.320523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:57.328615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1350/2704] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:16:57.333065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.342914 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364c66-b5b8-4e2d-9db5-10ebf8a849c7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.347737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.348328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.348604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.348908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.349583 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:16:57.349885 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.351482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.363463 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1355/2705] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:16:57.367666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.377979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5950d2-f2ad-4708-9d64-edb6c45dcc75 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.383669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.384290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.384575 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.384838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.385470 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.387392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.421758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1351/2706] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:57.426136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.437479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c65fc9-47b7-49ef-9553-8dc1c597932b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.494637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.495269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.495482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.495745 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.496436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.498894 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.522387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1356/2707] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:57.526745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.539738 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd696-b8f9-4353-b9e8-73f35a7f19d0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.545761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.546570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.546905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.547239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.548066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.550525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.561478 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1352/2708] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:16:57.566007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.577013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d7f0d-1e70-4e27-a6b0-c24961e3e913 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.582431 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13d5b4-db14-40ba-8440-da2f0da543c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.583049 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d5b4-db14-40ba-8440-da2f0da543c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.583327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d5b4-db14-40ba-8440-da2f0da543c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.583598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d5b4-db14-40ba-8440-da2f0da543c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.584374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13d5b4-db14-40ba-8440-da2f0da543c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.586020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13d5b4-db14-40ba-8440-da2f0da543c6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.598080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1357/2709] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:16:57.602564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.613690 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ecfb6-3fb3-459b-ae13-5c0a0c44b295 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.618652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.619693 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.619969 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.620239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] PATH_INFO: `/v3/projects/e8b2268f382045f8948b5f3048348c45/users/b3560314fcb64e47bb079e79d70d4f31/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.636068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b2268f382045f8948b5f3048348c45, user_id=b3560314fcb64e47bb079e79d70d4f31, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.638854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.655866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1353/2710] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:57 2022] PUT /identity/v3/projects/e8b2268f382045f8948b5f3048348c45/users/b3560314fcb64e47bb079e79d70d4f31/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:16:57.667204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.667593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.667840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.698396 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] MFA Rules not processed for user `b3560314fcb64e47bb079e79d70d4f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:57.699653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:57.733851 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:57.771919 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1358/2711] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:57.776158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.795917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:57.846791 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588e167-d925-41c8-b119-a6ff7b01f9c4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.851454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.852072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.852352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.852672 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.853314 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.855203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:57.886126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1354/2712] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:57.890253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:57.901778 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161223b-9edd-4259-924b-618a4f6f7ba7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:57.981899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:57.982678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:57.982958 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:57.983218 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:57.983983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:57.986007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.008850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1359/2713] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:16:57 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:16:58.012967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.023533 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b9fea-866e-4f43-96cf-2259fa1462f0 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.028140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.028849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.029129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.029394 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.030041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.031647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.042081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1355/2714] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:58.046376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.058145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9baeed-fdb2-4215-a95e-fda504908fee admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.063227 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.063888 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.064164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.064408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] PATH_INFO: `/v3/projects/dc619e2f15fd406296454f85fc216981/users/8eefb90503024a72ba6e657d7f0e5a08/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.079466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc619e2f15fd406296454f85fc216981, user_id=8eefb90503024a72ba6e657d7f0e5a08, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.082177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.096551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1360/2715] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:58 2022] PUT /identity/v3/projects/dc619e2f15fd406296454f85fc216981/users/8eefb90503024a72ba6e657d7f0e5a08/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:16:58.100453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.111208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db46fd-6d60-4612-a0e4-4e4dfa955b51 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.171624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.172473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.173151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.173426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.173696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.173852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.174355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.176112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.190263 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1356/2716] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:58.190466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b6307-9936-4609-b476-37e84a1f42c2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.191811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.198005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.198682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.198959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.199223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] PATH_INFO: `/v3/users/59b345b89db449758eadd91155aec51d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.200518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b345b89db449758eadd91155aec51d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.202020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9484a94-ce8d-420b-a40f-e344f9558c1a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.202771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.207100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc530e8-d4b0-42de-afdb-4efa516f6353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.207771 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc530e8-d4b0-42de-afdb-4efa516f6353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.208028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc530e8-d4b0-42de-afdb-4efa516f6353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.208299 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc530e8-d4b0-42de-afdb-4efa516f6353 admin admin] PATH_INFO: `/v3/projects/dc619e2f15fd406296454f85fc216981/users/8eefb90503024a72ba6e657d7f0e5a08/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.210681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc530e8-d4b0-42de-afdb-4efa516f6353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc619e2f15fd406296454f85fc216981, user_id=8eefb90503024a72ba6e657d7f0e5a08, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.213415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc530e8-d4b0-42de-afdb-4efa516f6353 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.224441 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1357/2717] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:58 2022] PUT /identity/v3/projects/dc619e2f15fd406296454f85fc216981/users/8eefb90503024a72ba6e657d7f0e5a08/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:16:58.235757 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.236295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.236613 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.256254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b345b89db449758eadd91155aec51d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.264148 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b345b89db449758eadd91155aec51d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.267277 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] MFA Rules not processed for user `8eefb90503024a72ba6e657d7f0e5a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:58.268507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.273427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b345b89db449758eadd91155aec51d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.274241 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b345b89db449758eadd91155aec51d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.296597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-591bb72d-09c6-4c98-ac66-d78fb4297308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b345b89db449758eadd91155aec51d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.307727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1361/2718] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:16:58 2022] DELETE /identity/v3/users/59b345b89db449758eadd91155aec51d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:16:58.311911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.312201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.312471 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.333170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:58.334371 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.339923 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:58.351304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:58.359351 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1358/2719] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:16:58.370882 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.372407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.425641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1362/2720] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:58.436374 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.437815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.450339 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669027e-12e5-4098-9e8e-f61ca73f8ec4 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.501245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864f8d1-ec30-4336-8781-fce163915225 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.504997 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.505615 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.505883 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.506161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.512306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.513310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.513588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.513977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.516294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.517809 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.528259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1363/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:58.575204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.576647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.586747 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1359/2722] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:16:58.667169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.677313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80075303-d3b8-4534-ba52-660c785a636c service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.684373 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.685098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.685424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.685646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.687433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.749093 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.750557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.759739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1364/2723] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:16:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:16:58.818997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.820775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:58.836197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278f4fc-454f-4730-bb73-25030beb8bad service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:58.842419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:58.843334 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:58.843578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:58.843890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] PATH_INFO: `/v3/projects/e0dd1de2111d40d1b45a558db67c055b` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:58.845166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0dd1de2111d40d1b45a558db67c055b)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:58.847148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:58.905265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0dd1de2111d40d1b45a558db67c055b', 'request_id': 'req-beee5e2a-1d9d-463d-90c2-934fc9dd982c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.913022 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0dd1de2111d40d1b45a558db67c055b', 'request_id': 'req-beee5e2a-1d9d-463d-90c2-934fc9dd982c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.917586 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:58.920261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0dd1de2111d40d1b45a558db67c055b', 'request_id': 'req-beee5e2a-1d9d-463d-90c2-934fc9dd982c'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.934968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] The token cache is being invalidate because project e0dd1de2111d40d1b45a558db67c055b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:16:58.935254 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.935861 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:58.937450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1360/2724] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:16:58 2022] DELETE /identity/v3/projects/e0dd1de2111d40d1b45a558db67c055b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:58.941635 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:58.952784 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93590e8d-647f-491b-a20a-ce8acd05fd34 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.004016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:59.013953 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.014597 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.014869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.015139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] PATH_INFO: `/v3/users/2993788dab5a4cf097ed58e94f4806a8` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.016349 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2993788dab5a4cf097ed58e94f4806a8)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.018340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.067740 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2993788dab5a4cf097ed58e94f4806a8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.076317 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2993788dab5a4cf097ed58e94f4806a8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.085503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2993788dab5a4cf097ed58e94f4806a8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.086112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2993788dab5a4cf097ed58e94f4806a8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.098432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3cc26a4d-c5bd-44b6-900a-0b0524ba627f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2993788dab5a4cf097ed58e94f4806a8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.104415 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1365/2725] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:16:58 2022] DELETE /identity/v3/users/2993788dab5a4cf097ed58e94f4806a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:59.375577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.377250 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:59.391399 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5e2a-1d9d-463d-90c2-934fc9dd982c admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.448618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.449292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.449574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.449840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] PATH_INFO: `/v3/projects/715e92b1f1f140308b64a0640bb819e5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.451144 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] RBAC: Authorizing `identity:delete_project(project_id=715e92b1f1f140308b64a0640bb819e5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.453081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.500723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715e92b1f1f140308b64a0640bb819e5', 'request_id': 'req-952a0cd4-ef97-450e-b4bb-83e126b3438b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.507456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715e92b1f1f140308b64a0640bb819e5', 'request_id': 'req-952a0cd4-ef97-450e-b4bb-83e126b3438b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.513832 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715e92b1f1f140308b64a0640bb819e5', 'request_id': 'req-952a0cd4-ef97-450e-b4bb-83e126b3438b'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.528691 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] The token cache is being invalidate because project 715e92b1f1f140308b64a0640bb819e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:16:59.529018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.529648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-952a0cd4-ef97-450e-b4bb-83e126b3438b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:16:59.531153 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1361/2726] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:16:59 2022] DELETE /identity/v3/projects/715e92b1f1f140308b64a0640bb819e5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:16:59.536328 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.536777 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.537023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.556685 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:59.557946 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:59.620986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1366/2727] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:59.629253 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.629541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.629996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.664725 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:16:59.665949 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:16:59.676943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1362/2728] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:16:59.681519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.691462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721deba-2816-4981-aeb3-c48db279bdd2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.696721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.697372 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.697650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.697924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.698601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:16:59.698903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.704078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.713074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1367/2729] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:16:59.717518 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.726590 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc865e5-8d4e-4136-938a-3e16d0e02fdc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.731278 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.731959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.732230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.732492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.733148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.735050 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.765525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1363/2730] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:16:59 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:59.769855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.780356 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3956-dce3-4957-9550-2a640ee98bff admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.842719 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.843340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.843619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.843890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.844541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.846521 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.854430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:16:59.870758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1368/2731] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:16:59 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:16:59.875069 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.885971 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f166d46-2102-4d2c-bd9f-f1d2d09a8873 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.891733 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.892328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.892597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.892870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.893545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.895154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.906345 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1364/2732] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:59.910589 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.923460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6619a-a694-40d3-92d9-ede070ffe2e8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.929172 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe58d3-42d5-4223-83e7-53adf749094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.929818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe58d3-42d5-4223-83e7-53adf749094a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.930096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe58d3-42d5-4223-83e7-53adf749094a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.930460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe58d3-42d5-4223-83e7-53adf749094a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.931022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe58d3-42d5-4223-83e7-53adf749094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.932655 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe58d3-42d5-4223-83e7-53adf749094a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.945500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1369/2733] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:16:59.950133 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:16:59.961037 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f909a34-501f-4f2f-8ea5-2940133f905a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:16:59.966612 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:16:59.967273 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:16:59.967552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:16:59.967826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] PATH_INFO: `/v3/projects/a401f81ca14245d5a2ebf49a29eda119/users/192dc81941014821ad7786d386714301/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:16:59.982614 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a401f81ca14245d5a2ebf49a29eda119, user_id=192dc81941014821ad7786d386714301, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:16:59.985318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:16:59.999946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1365/2734] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:16:59 2022] PUT /identity/v3/projects/a401f81ca14245d5a2ebf49a29eda119/users/192dc81941014821ad7786d386714301/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:00.011927 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.012318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.012593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.040676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] MFA Rules not processed for user `192dc81941014821ad7786d386714301`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:00.041932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:00.109434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1370/2735] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:00.115002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.130519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:00.186979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b781d-05fa-41fc-9416-9775202cb527 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.192174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.193165 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.193534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.193872 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.194579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.196527 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.226803 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1366/2736] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:00 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:00.231132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.251698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149dda0-9922-4360-8642-99d7817e3234 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.320979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.322118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.322118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.322351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.322816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.324747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.345483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1371/2737] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:00 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:00.349742 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.360067 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df5bf5-82a8-4a8d-8795-cd4b0a93d319 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.364587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.365228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.365505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.365773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.366415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.367999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.379025 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1367/2738] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:00.383351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.394184 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad4d3-ba3a-43cb-931d-03b0663ebf81 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.399625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.400330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.400605 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.400973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] PATH_INFO: `/v3/projects/3b3717b4148649fe930fc6d72346c49c/users/c3bde28c6bc74da4a4c40a1937b9874f/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.416571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3717b4148649fe930fc6d72346c49c, user_id=c3bde28c6bc74da4a4c40a1937b9874f, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.419275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.435333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1372/2739] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:00 2022] PUT /identity/v3/projects/3b3717b4148649fe930fc6d72346c49c/users/c3bde28c6bc74da4a4c40a1937b9874f/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:00.439468 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.449932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a675759-34d0-4de2-8629-cef43539977e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.508600 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd9d6f-8c14-4b81-b737-5a7615c01351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.509480 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd9d6f-8c14-4b81-b737-5a7615c01351 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.509761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd9d6f-8c14-4b81-b737-5a7615c01351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.510029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd9d6f-8c14-4b81-b737-5a7615c01351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.510765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd9d6f-8c14-4b81-b737-5a7615c01351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.512626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd9d6f-8c14-4b81-b737-5a7615c01351 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.522617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1368/2740] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:00.527116 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.537771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e229161-7f73-4ade-ba02-510ed8751c96 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.543063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.543723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.544102 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.544376 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] PATH_INFO: `/v3/projects/3b3717b4148649fe930fc6d72346c49c/users/c3bde28c6bc74da4a4c40a1937b9874f/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.546542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3717b4148649fe930fc6d72346c49c, user_id=c3bde28c6bc74da4a4c40a1937b9874f, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.549283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.560311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1373/2741] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:00 2022] PUT /identity/v3/projects/3b3717b4148649fe930fc6d72346c49c/users/c3bde28c6bc74da4a4c40a1937b9874f/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:00.570838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.571140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.571408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.599787 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] MFA Rules not processed for user `c3bde28c6bc74da4a4c40a1937b9874f`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:00.601039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:00.681814 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1369/2742] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:00.693758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:00.695759 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:00.719335 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:00.755981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6624f9e-973d-4e8b-b1e4-2f549acca7c5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:00.760020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2456eec-1768-40cb-80de-839080191308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:00.760628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2456eec-1768-40cb-80de-839080191308 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:00.760913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2456eec-1768-40cb-80de-839080191308 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:00.761185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2456eec-1768-40cb-80de-839080191308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:00.771139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2456eec-1768-40cb-80de-839080191308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:00.772592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2456eec-1768-40cb-80de-839080191308 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:00.782033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1374/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:01.198657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:01.208406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:01.266230 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6499-27bf-486a-a00c-11d0a4bde826 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:01.271236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:01.271868 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:01.272151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:01.272412 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] PATH_INFO: `/v3/users/192dc81941014821ad7786d386714301` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:01.273723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=192dc81941014821ad7786d386714301)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:01.275671 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:01.330308 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192dc81941014821ad7786d386714301'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.343866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192dc81941014821ad7786d386714301'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.344588 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192dc81941014821ad7786d386714301'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.345215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192dc81941014821ad7786d386714301'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.352221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192dc81941014821ad7786d386714301'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.366649 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1370/2744] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:01 2022] DELETE /identity/v3/users/192dc81941014821ad7786d386714301 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:01.372550 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:01.373012 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:01.373367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:01.392862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:01.394063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:01.456442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1375/2745] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:01.465968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:01.467164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:01.529783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a88b83-b2cd-47ab-8fb2-751f30f39b6b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:01.533505 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:01.534117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:01.534398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:01.534684 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:01.544731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:01.546231 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:01.555924 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1371/2746] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:01.836503 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:01.838143 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:01.851811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b7264-1054-4cb0-b3bc-0b6f0fe74a8a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:01.857019 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:01.858043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:01.858327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:01.858604 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] PATH_INFO: `/v3/projects/a401f81ca14245d5a2ebf49a29eda119` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:01.860345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a401f81ca14245d5a2ebf49a29eda119)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:01.862549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:01.917549 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a401f81ca14245d5a2ebf49a29eda119', 'request_id': 'req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.923984 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a401f81ca14245d5a2ebf49a29eda119', 'request_id': 'req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.932084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a401f81ca14245d5a2ebf49a29eda119', 'request_id': 'req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.943820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] The token cache is being invalidate because project a401f81ca14245d5a2ebf49a29eda119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:01.944107 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.944837 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:01.946570 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1376/2747] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:01 2022] DELETE /identity/v3/projects/a401f81ca14245d5a2ebf49a29eda119 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:01.950812 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:01.960568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e42da-6ec2-4a62-8693-79acd9a74697 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:01.990629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:02.020647 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.021306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.021582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.021847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] PATH_INFO: `/v3/users/c3bde28c6bc74da4a4c40a1937b9874f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.022965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bde28c6bc74da4a4c40a1937b9874f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.024903 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.073731 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bde28c6bc74da4a4c40a1937b9874f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.086409 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bde28c6bc74da4a4c40a1937b9874f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.087158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bde28c6bc74da4a4c40a1937b9874f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.087768 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bde28c6bc74da4a4c40a1937b9874f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.094818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-f97c4816-746c-4637-a7cb-fd085403e66c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bde28c6bc74da4a4c40a1937b9874f'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.108888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1372/2748] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:01 2022] DELETE /identity/v3/users/c3bde28c6bc74da4a4c40a1937b9874f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:02.393931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.395486 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:02.410274 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df7b2-d5ee-4766-8375-ac0030a3ebe6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.455810 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:02.470647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.471248 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.471524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.471790 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] PATH_INFO: `/v3/projects/3b3717b4148649fe930fc6d72346c49c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.472954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3717b4148649fe930fc6d72346c49c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.474864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.523818 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3717b4148649fe930fc6d72346c49c', 'request_id': 'req-0e90d1f3-0e02-477b-a492-35c588aa76c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.529973 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3717b4148649fe930fc6d72346c49c', 'request_id': 'req-0e90d1f3-0e02-477b-a492-35c588aa76c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.538607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3717b4148649fe930fc6d72346c49c', 'request_id': 'req-0e90d1f3-0e02-477b-a492-35c588aa76c8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.550022 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] The token cache is being invalidate because project 3b3717b4148649fe930fc6d72346c49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:02.550303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.551008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0e90d1f3-0e02-477b-a492-35c588aa76c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:02.552593 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1377/2749] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:02 2022] DELETE /identity/v3/projects/3b3717b4148649fe930fc6d72346c49c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:02.557724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.558229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.558371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.579401 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:02.580630 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:02.641212 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1373/2750] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:02.650484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.650764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.651032 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.673258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:02.674466 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:02.683285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1378/2751] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:02.687870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.698294 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa827f8-2fc6-4562-bc17-d1138d3ca314 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.704002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.704624 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.704926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.705161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.705811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:02.706104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.707697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.719847 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1374/2752] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:17:02.724345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.733684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d2969-ada1-4a54-b78d-6b86850bdadf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.738772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.739364 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.739641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.739910 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.740564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.742524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.774730 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1379/2753] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:02 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:02.778984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.789216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2fda9-c5d3-495e-9436-eddd3a869c3b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.823809 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:02.849448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.850053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.850355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.850621 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.851268 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.853193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.877271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1375/2754] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:02 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:02.881721 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.892313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043a44e-3925-44b8-9bfd-e348b45be845 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.897066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.897672 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.897948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.898221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.898905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.900519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.910781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1380/2755] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:02.914900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.925056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c10bc-f0d8-42c0-a745-fe90280dc813 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.930458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3224d-4e85-4743-a4d5-63710115d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.931046 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3224d-4e85-4743-a4d5-63710115d014 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.931325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3224d-4e85-4743-a4d5-63710115d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.931594 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3224d-4e85-4743-a4d5-63710115d014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.932239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3224d-4e85-4743-a4d5-63710115d014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.933862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3224d-4e85-4743-a4d5-63710115d014 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.943751 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1376/2756] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:02.948168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:02.958483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80160-4b15-426a-96c1-0fca869b5f28 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:02.963579 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:02.964208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:02.964482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:02.964747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] PATH_INFO: `/v3/projects/854ae2364a3c41dcbb74723e3fe68045/users/7bef4a97ac5f4f23b717160a3abdd8c4/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:02.979957 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854ae2364a3c41dcbb74723e3fe68045, user_id=7bef4a97ac5f4f23b717160a3abdd8c4, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:02.982587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:02.998177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1381/2757] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:02 2022] PUT /identity/v3/projects/854ae2364a3c41dcbb74723e3fe68045/users/7bef4a97ac5f4f23b717160a3abdd8c4/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:03.008595 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.008914 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.009197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.038236 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] MFA Rules not processed for user `7bef4a97ac5f4f23b717160a3abdd8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:03.039467 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:03.108557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1377/2758] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:03.113228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.180395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282a7e-a8eb-4f2c-b74a-0f0940cbdce0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.185699 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.186324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.186601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.186873 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.187535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.189484 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.218282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:03.232276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1382/2759] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:03 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:03.233526 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.246005 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400c01-04b1-47a9-b32f-eff1ccf78019 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.337116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.338068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.338406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.338650 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.339785 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.341295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.383366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1378/2760] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:03 2022] POST /identity/v3/users => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:03.387236 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.398071 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14507aa7-b84f-4fe9-8ec3-1236f78560d4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.402704 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.403457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.403748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.404023 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.404718 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.406481 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.417052 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1383/2761] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:03.421558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.432454 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5ef1c-d9fd-4fbf-9ac3-26e1c7d04231 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.437716 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.438336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.438666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.438938 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] PATH_INFO: `/v3/projects/4c291154b1044da4aba414f13e2f8981/users/f791f00c299341ca8a893b5fd256af75/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.456385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c291154b1044da4aba414f13e2f8981, user_id=f791f00c299341ca8a893b5fd256af75, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.459079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.473862 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1379/2762] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:03 2022] PUT /identity/v3/projects/4c291154b1044da4aba414f13e2f8981/users/f791f00c299341ca8a893b5fd256af75/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:03.478197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.489110 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce14b6a-9648-4662-b19b-c45917a4d783 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.547495 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4586-d41c-48df-9988-8d9ec567b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.548114 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4586-d41c-48df-9988-8d9ec567b2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.548393 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4586-d41c-48df-9988-8d9ec567b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.548664 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4586-d41c-48df-9988-8d9ec567b2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.549370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4586-d41c-48df-9988-8d9ec567b2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.551005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4586-d41c-48df-9988-8d9ec567b2b9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.561058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1384/2763] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:03.565363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.577000 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d399bf-3884-4850-91f9-1883e9765ffc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.583002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.583765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.584100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.584438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] PATH_INFO: `/v3/projects/4c291154b1044da4aba414f13e2f8981/users/f791f00c299341ca8a893b5fd256af75/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.586479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c291154b1044da4aba414f13e2f8981, user_id=f791f00c299341ca8a893b5fd256af75, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.589450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.595778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:03.601830 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1380/2764] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:03 2022] PUT /identity/v3/projects/4c291154b1044da4aba414f13e2f8981/users/f791f00c299341ca8a893b5fd256af75/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:03.612771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.613103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.613360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.643269 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] MFA Rules not processed for user `f791f00c299341ca8a893b5fd256af75`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:03.644493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:03.728782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1385/2765] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:03.740191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.742081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:03.801616 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acf96c-37cf-41c5-8ca5-a76c137e8ca1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.807653 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.808552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.808950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.809324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.821864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.823293 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.833310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1381/2766] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:03.889212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:03.891347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:03.908860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51f0d-5a87-42b0-910d-115c2eeab425 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:03.913196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04a97-d5e5-49d2-9e3c-b6072af11815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:03.913840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04a97-d5e5-49d2-9e3c-b6072af11815 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:03.914119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04a97-d5e5-49d2-9e3c-b6072af11815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:03.914387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04a97-d5e5-49d2-9e3c-b6072af11815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:03.971989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04a97-d5e5-49d2-9e3c-b6072af11815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:03.973500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04a97-d5e5-49d2-9e3c-b6072af11815 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:03.982467 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1386/2767] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:06.039758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:06.041450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:06.111773 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc15be-6b1e-42fc-8caa-00c6bc17d646 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:06.116340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:06.117019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:06.117315 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:06.117626 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] PATH_INFO: `/v3/users/b3560314fcb64e47bb079e79d70d4f31` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:06.118740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3560314fcb64e47bb079e79d70d4f31)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:06.121029 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:06.175372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3560314fcb64e47bb079e79d70d4f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.188288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3560314fcb64e47bb079e79d70d4f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.189139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3560314fcb64e47bb079e79d70d4f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.190085 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3560314fcb64e47bb079e79d70d4f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.199606 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3560314fcb64e47bb079e79d70d4f31'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.213320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1382/2768] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:06 2022] DELETE /identity/v3/users/b3560314fcb64e47bb079e79d70d4f31 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:06.217916 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:06.218401 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:06.218501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:06.232322 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:06.238872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:06.240051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:06.298208 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1387/2769] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:06.308560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:06.310282 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:06.334712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:06.373635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2e481-4c23-40c5-b879-7fdb0dda1c83 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:06.378166 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:06.378798 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:06.379094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:06.379361 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:06.389502 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:06.390946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:06.403007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1383/2770] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:06.690989 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:06.692531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:06.714761 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf60c-250a-4469-94d2-7ebe8691389e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:06.720824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:06.721528 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:06.721891 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:06.722037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] PATH_INFO: `/v3/projects/e8b2268f382045f8948b5f3048348c45` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:06.723281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b2268f382045f8948b5f3048348c45)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:06.725194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:06.776751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b2268f382045f8948b5f3048348c45', 'request_id': 'req-9fb557c4-063a-49b3-b194-a79241fe76a9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.782738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b2268f382045f8948b5f3048348c45', 'request_id': 'req-9fb557c4-063a-49b3-b194-a79241fe76a9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.790030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b2268f382045f8948b5f3048348c45', 'request_id': 'req-9fb557c4-063a-49b3-b194-a79241fe76a9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.801465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] The token cache is being invalidate because project e8b2268f382045f8948b5f3048348c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:06.801750 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.802457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.804050 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1388/2771] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:06 2022] DELETE /identity/v3/projects/e8b2268f382045f8948b5f3048348c45 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:06.808187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:06.818419 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760df82-3027-45c1-8c0a-da6255777e8f service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:06.876618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:06.877191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:06.877471 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:06.877865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] PATH_INFO: `/v3/users/8eefb90503024a72ba6e657d7f0e5a08` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:06.879020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eefb90503024a72ba6e657d7f0e5a08)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:06.880959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:06.930234 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eefb90503024a72ba6e657d7f0e5a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.943089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eefb90503024a72ba6e657d7f0e5a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.943876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eefb90503024a72ba6e657d7f0e5a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.944498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eefb90503024a72ba6e657d7f0e5a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.952657 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eefb90503024a72ba6e657d7f0e5a08'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:06.968227 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1384/2772] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:06 2022] DELETE /identity/v3/users/8eefb90503024a72ba6e657d7f0e5a08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:07.257562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.259081 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:07.271988 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb557c4-063a-49b3-b194-a79241fe76a9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.334921 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.335773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.336029 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.336367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] PATH_INFO: `/v3/projects/dc619e2f15fd406296454f85fc216981` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.337855 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc619e2f15fd406296454f85fc216981)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.340491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.378064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:07.392843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc619e2f15fd406296454f85fc216981', 'request_id': 'req-6c87f881-adfd-4a69-abf9-5d865e0f2252'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.399080 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc619e2f15fd406296454f85fc216981', 'request_id': 'req-6c87f881-adfd-4a69-abf9-5d865e0f2252'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.400931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.402448 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:07.407395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc619e2f15fd406296454f85fc216981', 'request_id': 'req-6c87f881-adfd-4a69-abf9-5d865e0f2252'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.415739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb256c-d124-4422-9eae-2f52ac8b0901 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.418906 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] The token cache is being invalidate because project dc619e2f15fd406296454f85fc216981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:07.419196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.419822 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6c87f881-adfd-4a69-abf9-5d865e0f2252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.421527 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1389/2773] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:07 2022] DELETE /identity/v3/projects/dc619e2f15fd406296454f85fc216981 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:07.426096 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751758-18fc-4d94-8297-df2dfdfb12ca None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.426378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751758-18fc-4d94-8297-df2dfdfb12ca None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.426646 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751758-18fc-4d94-8297-df2dfdfb12ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.445602 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9a751758-18fc-4d94-8297-df2dfdfb12ca None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:07.446816 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9a751758-18fc-4d94-8297-df2dfdfb12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:07.456168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:07.475673 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.476417 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.476703 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.477126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] PATH_INFO: `/v3/users/7bef4a97ac5f4f23b717160a3abdd8c4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.478270 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bef4a97ac5f4f23b717160a3abdd8c4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.480678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.509947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1390/2774] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:07.520434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.520706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.521007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.533372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bef4a97ac5f4f23b717160a3abdd8c4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.542405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:07.543675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:07.546413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bef4a97ac5f4f23b717160a3abdd8c4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.547071 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bef4a97ac5f4f23b717160a3abdd8c4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.547677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bef4a97ac5f4f23b717160a3abdd8c4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.551836 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1391/2775] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:07.554819 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-60f40cd6-0de5-4598-b032-48c983730c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bef4a97ac5f4f23b717160a3abdd8c4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:07.556048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.566014 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7c14e-edbd-433d-a349-11bb867b3d40 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.569081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1385/2776] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:07 2022] DELETE /identity/v3/users/7bef4a97ac5f4f23b717160a3abdd8c4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:07.570933 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.571592 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.571871 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.572141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.572789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:07.573119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.573266 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.573557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.573839 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.574748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.587562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1392/2777] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:17:07.592043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.593740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:07.594967 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:07.602420 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f321aa-9199-4d38-800a-4ab950bcc2a6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.656637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1386/2778] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:07.659727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.660733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.660733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.660952 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.661624 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.663552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.668193 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.669644 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:07.695581 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1393/2779] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:07 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:07.699848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.733482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:07.734745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d4aeb-8000-4c43-be19-fdf3b40dc517 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.747730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:07.769993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb233d-7d93-430d-890c-a755a3fc81a4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.774684 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.775299 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.775578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.775852 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.776491 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.778451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.784066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.784678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.784985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.785256 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.794702 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.796168 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.800033 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1394/2780] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:07 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:07.804069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.809112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1387/2781] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:17:07.814418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff1595-5d3f-44de-b1aa-a0cfdd56b464 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.818979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.819596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.819867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.820137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.820786 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.822421 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.832540 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1395/2782] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:07.836592 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.846844 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2c10-6137-4beb-8a2a-c37ba3be3353 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.851391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a62414-3a9e-4550-aa4c-6a2a59256b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.851993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62414-3a9e-4550-aa4c-6a2a59256b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.852267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62414-3a9e-4550-aa4c-6a2a59256b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.852537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62414-3a9e-4550-aa4c-6a2a59256b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.853357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a62414-3a9e-4550-aa4c-6a2a59256b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.854976 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a62414-3a9e-4550-aa4c-6a2a59256b71 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.866343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1388/2783] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:07.871115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:07.881370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaec1f0-01d9-4b53-bcc9-68c9023c2de0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:07.886478 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:07.887157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.887432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.887712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] PATH_INFO: `/v3/projects/05b9d8631d994cdc9a9a2ab6b61cffae/users/b9192408eaa7446b85c551a23a70bb8d/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.903444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b9d8631d994cdc9a9a2ab6b61cffae, user_id=b9192408eaa7446b85c551a23a70bb8d, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:07.906198 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:07.920020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1396/2784] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:07 2022] PUT /identity/v3/projects/05b9d8631d994cdc9a9a2ab6b61cffae/users/b9192408eaa7446b85c551a23a70bb8d/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:07.930717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:07.931002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:07.931323 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:07.963019 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] MFA Rules not processed for user `b9192408eaa7446b85c551a23a70bb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:07.964403 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.033560 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1389/2785] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:08.038526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.095433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.099449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.109892 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4967f-3d25-4bfe-b5fc-ea981f9577af admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.114893 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.115600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.115876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.116436 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.117141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.119084 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.128154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766214-00b5-4904-99ab-78d0ac3a3476 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.133408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.134160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.134330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.134597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] PATH_INFO: `/v3/projects/854ae2364a3c41dcbb74723e3fe68045` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.135675 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854ae2364a3c41dcbb74723e3fe68045)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.137889 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.149341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1397/2786] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:08 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:08.154060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.196186 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854ae2364a3c41dcbb74723e3fe68045', 'request_id': 'req-482e37ca-dd8d-4581-b23b-eeaad2e1b122'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.204229 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854ae2364a3c41dcbb74723e3fe68045', 'request_id': 'req-482e37ca-dd8d-4581-b23b-eeaad2e1b122'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.211596 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854ae2364a3c41dcbb74723e3fe68045', 'request_id': 'req-482e37ca-dd8d-4581-b23b-eeaad2e1b122'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.228391 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] The token cache is being invalidate because project 854ae2364a3c41dcbb74723e3fe68045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:08.228524 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90c88f-dcd9-4ef4-b5ef-50b2ed78594a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.229031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.230027 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.232884 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1390/2787] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:08 2022] DELETE /identity/v3/projects/854ae2364a3c41dcbb74723e3fe68045 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:08.237123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.238717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.242209 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:08.270267 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:08.295651 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.296284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.296561 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.296860 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.297507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.299453 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.314853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e37ca-dd8d-4581-b23b-eeaad2e1b122 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.319998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.320952 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.321075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.321319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] PATH_INFO: `/v3/users/f791f00c299341ca8a893b5fd256af75` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.325196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1398/2788] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:08 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:08.325350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f791f00c299341ca8a893b5fd256af75)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.325350 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.326357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.328347 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.342211 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240ba9a-f135-4ef1-a84f-a5e48e1fb968 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.347815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.348468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.348765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.349059 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.349723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.351339 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.364007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1399/2789] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:08.368359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.381221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d3014-eb04-46bd-a5a2-311be00378be admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.381476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f791f00c299341ca8a893b5fd256af75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.387558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.388258 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.388552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.388875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] PATH_INFO: `/v3/projects/a2f183bf833544f0912d1302922dc8ab/users/ce291dea0f3e4694889b5db985873771/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.397357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f791f00c299341ca8a893b5fd256af75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.398248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f791f00c299341ca8a893b5fd256af75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.398997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f791f00c299341ca8a893b5fd256af75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.406264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f183bf833544f0912d1302922dc8ab, user_id=ce291dea0f3e4694889b5db985873771, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.406980 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f791f00c299341ca8a893b5fd256af75'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.409177 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.421045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1391/2790] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:08 2022] DELETE /identity/v3/users/f791f00c299341ca8a893b5fd256af75 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:08.425935 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1400/2791] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:08 2022] PUT /identity/v3/projects/a2f183bf833544f0912d1302922dc8ab/users/ce291dea0f3e4694889b5db985873771/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:08.429989 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.431558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.521082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e25f-9d04-4337-81d5-8f9fe6d58e0f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.526664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a3bd5-b4d4-4929-8854-57cc0a203cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.527577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3bd5-b4d4-4929-8854-57cc0a203cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.528073 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3bd5-b4d4-4929-8854-57cc0a203cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.528531 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3bd5-b4d4-4929-8854-57cc0a203cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.529493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a3bd5-b4d4-4929-8854-57cc0a203cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.531373 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a3bd5-b4d4-4929-8854-57cc0a203cf1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.547964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.549476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1392/2792] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:08.634251 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e959301-3eae-4d61-bb55-f0390f8e9e73 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.639303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.640069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.640422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.640849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] PATH_INFO: `/v3/projects/a2f183bf833544f0912d1302922dc8ab/users/ce291dea0f3e4694889b5db985873771/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.642979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f183bf833544f0912d1302922dc8ab, user_id=ce291dea0f3e4694889b5db985873771, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.645789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.658773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1401/2793] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:08 2022] PUT /identity/v3/projects/a2f183bf833544f0912d1302922dc8ab/users/ce291dea0f3e4694889b5db985873771/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:08.671102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.671727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.671894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.717629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] MFA Rules not processed for user `ce291dea0f3e4694889b5db985873771`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:08.718960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.761638 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.763440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.767585 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:08.841857 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8309d-f9f2-4a9d-91de-12c590406031 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.848054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.848695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.849000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.849273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] PATH_INFO: `/v3/projects/4c291154b1044da4aba414f13e2f8981` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.850513 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c291154b1044da4aba414f13e2f8981)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:08.851929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1393/2794] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:08.852440 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:08.857215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:08.865726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:08.867783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.912205 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c291154b1044da4aba414f13e2f8981', 'request_id': 'req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.918117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c291154b1044da4aba414f13e2f8981', 'request_id': 'req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.928419 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c291154b1044da4aba414f13e2f8981', 'request_id': 'req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.930557 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996983aa-f502-4678-a95e-303c6fb6bf89 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:08.943164 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] The token cache is being invalidate because project 4c291154b1044da4aba414f13e2f8981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:08.943738 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.944875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bac13133-3ee7-4e7c-8e3f-591a6e0b63e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:08.947214 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1402/2795] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:08 2022] DELETE /identity/v3/projects/4c291154b1044da4aba414f13e2f8981 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:08.953587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290982-e438-4880-892d-7e0df536005c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.954072 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290982-e438-4880-892d-7e0df536005c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.954504 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290982-e438-4880-892d-7e0df536005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.976351 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d1290982-e438-4880-892d-7e0df536005c None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:08.977616 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d1290982-e438-4880-892d-7e0df536005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:08.991460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:08.992418 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:08.992780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:08.993261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:08.995416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:09.041094 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1403/2796] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:09.050342 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.050623 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.050905 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.064143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.065669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.071027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:09.072224 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:09.075724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1394/2797] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:09.080256 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1404/2798] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:09.084568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.095171 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aced2-8c91-4e5a-a3c4-9acbbad526ca service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.100676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.101354 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.101620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.101886 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.102529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:09.102827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.104426 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.117407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1395/2799] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:17:09.121974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.132369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072761f-a1d4-4e7c-9ade-157bc9a08cd6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.138005 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.138673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.139027 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.139311 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.139942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.141943 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.156774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.158721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:09.171129 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d7b0-fda1-416e-9cdd-e80b9327103d admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.172555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1405/2800] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:09 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:09.176711 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.184681 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:09.225138 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.225783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.226072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.226340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.228352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:09.241385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b461263-92ef-4d72-a841-07cf1f6ac8f1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.246329 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.246941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.247219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.247488 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.248152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.250179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.260078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:09.274175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1406/2801] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:09 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:09.278118 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.287811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e97f0-7b32-41d2-86a2-8eb392b7214c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.292385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.292700 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.292996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.293273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.293545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.294174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.294281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.295832 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.303663 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1396/2802] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:17:09.308680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1407/2803] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:09.310669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.321220 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d969e7-5077-4aef-8c7f-f244faeb832c service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.325818 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605297c-1114-4dea-91b2-fc08a4ddb1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.326491 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605297c-1114-4dea-91b2-fc08a4ddb1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.326778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605297c-1114-4dea-91b2-fc08a4ddb1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.327048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605297c-1114-4dea-91b2-fc08a4ddb1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.327704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605297c-1114-4dea-91b2-fc08a4ddb1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.329329 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605297c-1114-4dea-91b2-fc08a4ddb1f8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.339322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1397/2804] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:09.343675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.353845 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e8fc5-980e-48b6-91a9-171e9ebad0a2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.358732 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.359389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.359690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.359969 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] PATH_INFO: `/v3/projects/0b53446487a748ae9b30bbf2073d0ed7/users/617729389da340aab7e37fafca4ba408/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.375981 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b53446487a748ae9b30bbf2073d0ed7, user_id=617729389da340aab7e37fafca4ba408, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.378678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.392572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1408/2805] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:09 2022] PUT /identity/v3/projects/0b53446487a748ae9b30bbf2073d0ed7/users/617729389da340aab7e37fafca4ba408/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:09.403425 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.403536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.403900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.438656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] MFA Rules not processed for user `617729389da340aab7e37fafca4ba408`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:09.439968 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:09.507558 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1398/2806] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:09.518690 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:09.581723 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9a853-9e08-4688-983e-ce4edf944dd6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:09.587913 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d1043-0d49-473a-9314-1a143a8767d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:09.588795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1043-0d49-473a-9314-1a143a8767d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:09.589245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1043-0d49-473a-9314-1a143a8767d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:09.589477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1043-0d49-473a-9314-1a143a8767d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:09.599281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d1043-0d49-473a-9314-1a143a8767d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:09.600722 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d1043-0d49-473a-9314-1a143a8767d4 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:09.609979 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1409/2807] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:12.083566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:12.085059 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:12.145746 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:12.163943 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543c10c-8477-41a6-8a22-e387fa9260d1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:12.171030 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:12.171712 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:12.171992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:12.172309 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] PATH_INFO: `/v3/users/b9192408eaa7446b85c551a23a70bb8d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:12.175466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9192408eaa7446b85c551a23a70bb8d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:12.177677 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:12.238333 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9192408eaa7446b85c551a23a70bb8d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:12.251479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9192408eaa7446b85c551a23a70bb8d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:12.252174 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9192408eaa7446b85c551a23a70bb8d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:12.252769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9192408eaa7446b85c551a23a70bb8d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:12.260676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9192408eaa7446b85c551a23a70bb8d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:12.279370 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1399/2808] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:12 2022] DELETE /identity/v3/users/b9192408eaa7446b85c551a23a70bb8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:12.284091 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:12.284644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:12.284644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:12.447397 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:12.448530 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:12.510642 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1410/2809] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:12.521396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:12.523676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:12.586641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9aee7-78fc-462b-be35-26574c7424bc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:12.591105 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:12.592032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:12.592396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:12.592665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:12.603393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:12.604835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:12.614482 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1400/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:12.910183 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:12.911762 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:12.919237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:12.920724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:12.926181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59fd59-5812-4803-b9b0-e2357f320475 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:12.931320 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:12.932119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:12.932505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:12.932899 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] PATH_INFO: `/v3/projects/05b9d8631d994cdc9a9a2ab6b61cffae` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:12.934156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b9d8631d994cdc9a9a2ab6b61cffae)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:12.936223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:12.939741 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a240c-e268-49cc-86b0-b4b719775226 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:12.944838 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:12.945483 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:12.946439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:12.946589 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] PATH_INFO: `/v3/users/617729389da340aab7e37fafca4ba408` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:12.947807 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617729389da340aab7e37fafca4ba408)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:12.949764 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:12.989193 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b9d8631d994cdc9a9a2ab6b61cffae', 'request_id': 'req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:12.994053 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:12.995702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b9d8631d994cdc9a9a2ab6b61cffae', 'request_id': 'req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.001290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617729389da340aab7e37fafca4ba408'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.004501 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b9d8631d994cdc9a9a2ab6b61cffae', 'request_id': 'req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.015158 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617729389da340aab7e37fafca4ba408'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.016020 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617729389da340aab7e37fafca4ba408'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.016633 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] The token cache is being invalidate because project 05b9d8631d994cdc9a9a2ab6b61cffae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:13.016759 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617729389da340aab7e37fafca4ba408'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.017176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.017867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.018004 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:13.019844 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1411/2811] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:12 2022] DELETE /identity/v3/projects/05b9d8631d994cdc9a9a2ab6b61cffae => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:13.023975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.025359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.026490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-65b2523e-7800-477b-bc11-344472419ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617729389da340aab7e37fafca4ba408'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.040870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1401/2812] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:12 2022] DELETE /identity/v3/users/617729389da340aab7e37fafca4ba408 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:13.045222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.045507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.045801 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.064965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:13.066380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.091171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730092be-a47c-4ee2-9d4a-8cfd34a9f7b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.124782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1402/2813] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:13.134890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.136324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.147387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.148112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.148383 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.148650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] PATH_INFO: `/v3/users/ce291dea0f3e4694889b5db985873771` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.149887 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce291dea0f3e4694889b5db985873771)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.151793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.194183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa589929-7e81-485d-a1e2-b90a442c8b05 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.197811 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.198452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.198727 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.198995 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.200301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce291dea0f3e4694889b5db985873771'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.207362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce291dea0f3e4694889b5db985873771'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.208645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.210233 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.216056 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce291dea0f3e4694889b5db985873771'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.216692 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce291dea0f3e4694889b5db985873771'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.229028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1403/2814] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:13.233065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce291dea0f3e4694889b5db985873771'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.239544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1412/2815] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:13 2022] DELETE /identity/v3/users/ce291dea0f3e4694889b5db985873771 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:13.602683 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.604217 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.610555 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.612971 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.629433 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:13.632547 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb82d6-0f92-4921-9e56-37af72e413d8 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.687733 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe713-b0b9-4f8b-8d84-559bbba083a5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.696552 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.697237 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.697507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.698171 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] PATH_INFO: `/v3/projects/a2f183bf833544f0912d1302922dc8ab` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.698931 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f183bf833544f0912d1302922dc8ab)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.701024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.704385 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.705068 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.705347 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.705617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] PATH_INFO: `/v3/projects/0b53446487a748ae9b30bbf2073d0ed7` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.706743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b53446487a748ae9b30bbf2073d0ed7)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.708645 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.741666 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:13.749662 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f183bf833544f0912d1302922dc8ab', 'request_id': 'req-034d126b-ac03-4ccc-9358-04910e54c55f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.755250 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f183bf833544f0912d1302922dc8ab', 'request_id': 'req-034d126b-ac03-4ccc-9358-04910e54c55f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.759476 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b53446487a748ae9b30bbf2073d0ed7', 'request_id': 'req-5dcbe59c-816c-4aed-b163-da339e8e698d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.763045 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f183bf833544f0912d1302922dc8ab', 'request_id': 'req-034d126b-ac03-4ccc-9358-04910e54c55f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.766559 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b53446487a748ae9b30bbf2073d0ed7', 'request_id': 'req-5dcbe59c-816c-4aed-b163-da339e8e698d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.773708 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b53446487a748ae9b30bbf2073d0ed7', 'request_id': 'req-5dcbe59c-816c-4aed-b163-da339e8e698d'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.776675 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] The token cache is being invalidate because project a2f183bf833544f0912d1302922dc8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:13.776998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.777649 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-034d126b-ac03-4ccc-9358-04910e54c55f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.779155 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1413/2816] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:13 2022] DELETE /identity/v3/projects/a2f183bf833544f0912d1302922dc8ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:13.784758 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fed02f-52da-4d3a-87ed-132a77023f24 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.785512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fed02f-52da-4d3a-87ed-132a77023f24 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.785794 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fed02f-52da-4d3a-87ed-132a77023f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.787162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] The token cache is being invalidate because project 0b53446487a748ae9b30bbf2073d0ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:13.787543 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.788170 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5dcbe59c-816c-4aed-b163-da339e8e698d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:13.789900 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1404/2817] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:13 2022] DELETE /identity/v3/projects/0b53446487a748ae9b30bbf2073d0ed7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:13.794451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024ee1-0be4-4b77-951a-1706fca1255f None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.794740 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024ee1-0be4-4b77-951a-1706fca1255f None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.795015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024ee1-0be4-4b77-951a-1706fca1255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.806069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a7fed02f-52da-4d3a-87ed-132a77023f24 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:13.807569 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a7fed02f-52da-4d3a-87ed-132a77023f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.820288 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-dd024ee1-0be4-4b77-951a-1706fca1255f None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:13.821548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-dd024ee1-0be4-4b77-951a-1706fca1255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.872321 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1414/2818] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:13.880345 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.880751 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.881210 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.885523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1405/2819] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:13.894670 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.895178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.895456 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.904424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:13.905389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.913338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1415/2820] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:13.914749 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:13.915950 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:13.917578 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.924064 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1406/2821] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:13.927016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd724c1-b5ca-4f74-b9c8-1dc85b309f38 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.928191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.931557 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.932255 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.932409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.932674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.933346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:13.933644 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.935360 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.937021 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f657-e2dc-4ada-97a9-a4b5be0ea3a2 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.941735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.942322 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.942597 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.942858 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.943500 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:13.943802 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.945574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.950282 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1416/2822] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:17:13.951235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.960469 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1407/2823] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:17:13.960867 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b519-ce1e-4c76-8e6a-365780ecfdb6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.961781 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:13.965406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.966001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.966275 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.966544 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.967163 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.969252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.972407 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8e8af-16e8-444b-b249-bc4fc357c3f2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:13.977984 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:13.978593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:13.978871 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:13.979143 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:13.979782 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:13.981737 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:13.997007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:14.000083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1417/2824] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:14.004316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.013982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1408/2825] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:14.018172 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.066797 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5c1e4-ef8e-4138-b944-785cad9fdaa2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.079155 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bc2a0-80f2-4b60-8702-84dcb4b3b359 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.083840 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.084462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.084745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.085041 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.085706 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.087625 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.109800 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1409/2826] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:14.113856 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.120994 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:14.123246 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.123868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.124228 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.124500 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.125015 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586bc47-8c47-44f6-8cd7-5455374daeeb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.125490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.127069 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.131658 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.132261 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.132762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.133296 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.134042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.136398 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.147355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1410/2827] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:14.151422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.155031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1418/2828] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:14.156588 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.162134 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c4fe-5854-4485-834c-5762afc690bd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.167996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62fc6a-5d01-41bd-bb8c-5fd450b6b98c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.168486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.169228 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.169563 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.169760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.170404 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.172031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.173215 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.173842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.174365 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.174773 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.175426 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.177065 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.186541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1411/2829] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:14.187422 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.191653 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1419/2830] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:14.193004 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.197772 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c68a7-7467-4d97-a0af-ba4e32e3cda3 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.204629 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fd3cb-77eb-4381-9ba4-9bfcb5baef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.205717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fd3cb-77eb-4381-9ba4-9bfcb5baef2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.206197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fd3cb-77eb-4381-9ba4-9bfcb5baef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.206330 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b72bf-98d0-4356-b52f-d97bb02781ad admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.206637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fd3cb-77eb-4381-9ba4-9bfcb5baef2c admin admin] PATH_INFO: `/v3/projects/f7fd7e77286a4232a5843fa1b6ce1b76/users/83590e60af9d45f28280c5c7e55625d4/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.212848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.213802 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.214247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.214680 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.215714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.218628 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.230929 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fd3cb-77eb-4381-9ba4-9bfcb5baef2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fd7e77286a4232a5843fa1b6ce1b76, user_id=83590e60af9d45f28280c5c7e55625d4, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.234988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fd3cb-77eb-4381-9ba4-9bfcb5baef2c admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.240498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1420/2831] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:14.245696 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.251094 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1412/2832] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:14 2022] PUT /identity/v3/projects/f7fd7e77286a4232a5843fa1b6ce1b76/users/83590e60af9d45f28280c5c7e55625d4/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:14.256098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5735a-294c-4547-8942-eb12bb6d00b3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.261486 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.261766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.262040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.290066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] MFA Rules not processed for user `83590e60af9d45f28280c5c7e55625d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:14.291307 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:14.314088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c53de-d983-44f1-9ec1-784b682bec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.314756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c53de-d983-44f1-9ec1-784b682bec26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.315031 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c53de-d983-44f1-9ec1-784b682bec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.315300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c53de-d983-44f1-9ec1-784b682bec26 admin admin] PATH_INFO: `/v3/projects/6b2140a8b1fe4c429b1f0bcc41044eb8/users/c2d9009a29404478a76d17636a2a9516/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.330132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c53de-d983-44f1-9ec1-784b682bec26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2140a8b1fe4c429b1f0bcc41044eb8, user_id=c2d9009a29404478a76d17636a2a9516, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.332999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c53de-d983-44f1-9ec1-784b682bec26 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.341842 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:14.349789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1421/2833] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:14 2022] PUT /identity/v3/projects/6b2140a8b1fe4c429b1f0bcc41044eb8/users/c2d9009a29404478a76d17636a2a9516/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:14.358146 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1413/2834] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:14.360460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.360739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.361149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.362760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.374079 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e532da-3f27-411b-8e47-dd9dabe1294c None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.389245 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] MFA Rules not processed for user `c2d9009a29404478a76d17636a2a9516`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:14.390632 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:14.431264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.431878 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.432152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.432721 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.433080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.434982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.459681 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1422/2835] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:14.463493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1414/2836] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:14.464197 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.466088 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.477598 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e33d-4d41-474d-ab76-9a24310a5bf4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.508934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:14.543102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b517aad-399a-4f78-829d-3fc302f0bb5e admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.544131 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.544793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.545128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.545379 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.546170 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.548253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.548659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.549374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.549713 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.550048 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.550767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.552894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.574936 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1423/2837] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:14.579222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.583396 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1415/2838] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:14.587279 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.590117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a0651-9bad-4649-9fe3-c23691dc9ca0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.654479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.655470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.655470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.655884 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.656572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.656734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdbfdc-0c76-4cfa-bae5-ff00bdd61280 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.658425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.666007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.667870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.668150 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.668413 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.672108 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1424/2839] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:14.672265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.672265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.672998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.685439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f50f1-aec2-4698-8610-e2a41b4eaa24 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.697265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.698137 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.698512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.698964 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1416/2840] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:14.699089 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.699872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.705795 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.705982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.714381 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1425/2841] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:14.716303 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f35f46-df35-40b3-9c4c-8ba9b70122f8 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.719083 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.721728 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.722342 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.722620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.722887 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.723548 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.724749 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:14.725341 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.731647 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716fabf-5a68-462a-85dc-b9ddeff15c9f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.740066 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca22f14-f895-4da6-a214-3f11c354b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.740364 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1417/2842] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:14.740991 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22f14-f895-4da6-a214-3f11c354b460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.741340 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22f14-f895-4da6-a214-3f11c354b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.741808 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22f14-f895-4da6-a214-3f11c354b460 admin admin] PATH_INFO: `/v3/projects/b200bb7b0d13484d84b691bd67ccb7b8/users/974d5dbe8f3f40439091cfa1d2ea2070/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.744117 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.755582 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9176-1d2f-48f9-8b39-117b23915eea admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.760707 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.761427 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca22f14-f895-4da6-a214-3f11c354b460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b200bb7b0d13484d84b691bd67ccb7b8, user_id=974d5dbe8f3f40439091cfa1d2ea2070, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.761569 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.761828 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.762159 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] PATH_INFO: `/v3/projects/81481f2e7a004e63b20ee1979ef560cb/users/bd40d118659444a6bfec05e9d7c6754c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.764520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca22f14-f895-4da6-a214-3f11c354b460 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.778311 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81481f2e7a004e63b20ee1979ef560cb, user_id=bd40d118659444a6bfec05e9d7c6754c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.781562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.791307 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1426/2843] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:14 2022] PUT /identity/v3/projects/b200bb7b0d13484d84b691bd67ccb7b8/users/974d5dbe8f3f40439091cfa1d2ea2070/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:14.795061 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.795499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.796043 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.817201 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1418/2844] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:14 2022] PUT /identity/v3/projects/81481f2e7a004e63b20ee1979ef560cb/users/bd40d118659444a6bfec05e9d7c6754c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:14.821060 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.831168 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] MFA Rules not processed for user `974d5dbe8f3f40439091cfa1d2ea2070`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:14.832456 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:14.900758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f1cd-bd3c-458a-80c2-c5c987e60f83 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.906579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.907216 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.907493 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.907760 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.908416 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.910082 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.914156 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1427/2845] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:14.918804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.924855 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1419/2846] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:14.927867 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.929268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e82ff-7cb6-4d03-bd1d-1568ccbaf715 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.933920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a303bf3-d7d7-45f9-88ad-025abd30f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.934529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303bf3-d7d7-45f9-88ad-025abd30f1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.934806 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303bf3-d7d7-45f9-88ad-025abd30f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.935075 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a303bf3-d7d7-45f9-88ad-025abd30f1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.935726 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a303bf3-d7d7-45f9-88ad-025abd30f1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.937815 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a303bf3-d7d7-45f9-88ad-025abd30f1a3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.937988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77692249-a0e1-49b2-9718-179f4f29d113 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:14.942685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:14.943372 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.943656 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.943931 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] PATH_INFO: `/v3/projects/81481f2e7a004e63b20ee1979ef560cb/users/bd40d118659444a6bfec05e9d7c6754c/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:14.945962 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=81481f2e7a004e63b20ee1979ef560cb, user_id=bd40d118659444a6bfec05e9d7c6754c, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:14.948945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:14.952243 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:14.962534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1420/2847] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:14 2022] PUT /identity/v3/projects/81481f2e7a004e63b20ee1979ef560cb/users/bd40d118659444a6bfec05e9d7c6754c/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:14.969074 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1428/2848] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:14.973274 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:14.973909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:14.974194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:14.974462 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.002264 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] MFA Rules not processed for user `bd40d118659444a6bfec05e9d7c6754c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:15.003529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:15.040247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef6d1f-c132-46b8-b08e-d57ff5eb37cc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.071691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1429/2849] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:15.083034 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:15.084432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:15.096052 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.096678 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.096998 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.097332 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.097918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.099959 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.118724 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:15.124223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1421/2850] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:14 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:15.128921 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:15.139328 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3bada-6bc1-427b-9497-bca6fe1023b7 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.143036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6051e-c7dd-4e63-963c-d2cbc34b9c78 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.144793 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.145437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.145769 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.146039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.146694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.146824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.147434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.147709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.147978 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.148321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.158550 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1422/2851] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:15.162718 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:15.172140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d00742-4e6b-4537-9e15-62adc4baef4f admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.176617 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.177271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.177554 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.177815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] PATH_INFO: `/v3/projects/5ece98188ade4c31aec9dc4d5c6f2a2c/users/fdadabe3cc024d5da0cb142ca3c1efd4/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.192036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ece98188ade4c31aec9dc4d5c6f2a2c, user_id=fdadabe3cc024d5da0cb142ca3c1efd4, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.194909 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.206257 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.207954 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.208107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1423/2852] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:15 2022] PUT /identity/v3/projects/5ece98188ade4c31aec9dc4d5c6f2a2c/users/fdadabe3cc024d5da0cb142ca3c1efd4/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:15.211917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:15.217526 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1430/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:15.272327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:15.276447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de6d8-302f-4341-a4fb-fe23e69c24ef admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.283602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2f20a-c738-4e71-a66b-d4052c67d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.284247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f20a-c738-4e71-a66b-d4052c67d82e admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.284494 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f20a-c738-4e71-a66b-d4052c67d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.284761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2f20a-c738-4e71-a66b-d4052c67d82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.285455 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f20a-c738-4e71-a66b-d4052c67d82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.287080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2f20a-c738-4e71-a66b-d4052c67d82e admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.297477 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1424/2854] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:15.302157 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:15.313332 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a81df-9662-41f4-ba10-37bc397cab0e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.318545 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.319247 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.319551 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.319875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] PATH_INFO: `/v3/projects/5ece98188ade4c31aec9dc4d5c6f2a2c/users/fdadabe3cc024d5da0cb142ca3c1efd4/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.322185 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ece98188ade4c31aec9dc4d5c6f2a2c, user_id=fdadabe3cc024d5da0cb142ca3c1efd4, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.325001 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.336145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1431/2855] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:15 2022] PUT /identity/v3/projects/5ece98188ade4c31aec9dc4d5c6f2a2c/users/fdadabe3cc024d5da0cb142ca3c1efd4/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:15.411577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.411864 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.412139 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.441465 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] MFA Rules not processed for user `fdadabe3cc024d5da0cb142ca3c1efd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:15.442897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:15.548857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1425/2856] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:15.559948 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:15.622974 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6b5ba-3713-40b2-a6b8-6b71f9efe54e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:15.626619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:15.627235 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:15.627507 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:15.627772 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:15.684625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:15.686125 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:15.695479 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1432/2857] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:17.233577 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:17.243608 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e8a3-4292-4f7f-b842-4ab868b521fc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:17.247926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:17.248529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:17.249001 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:17.249439 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:17.307148 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:17.308619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:17.317685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1426/2858] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:17.859668 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:17.861123 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:17.873607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f7515-132d-4ecb-b7f7-3f4e6c8d836c service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:17.877942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5731946-367e-4b90-85c4-87826857a98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:17.878558 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731946-367e-4b90-85c4-87826857a98c service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:17.878838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731946-367e-4b90-85c4-87826857a98c service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:17.879109 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5731946-367e-4b90-85c4-87826857a98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:17.892156 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:17.901033 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f7038-1329-4ef9-a260-ffdd89edd677 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:17.904534 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:17.904685 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:17.905415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:17.905698 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:17.905991 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:17.915696 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:17.917189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:17.927879 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1427/2859] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:17.946223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5731946-367e-4b90-85c4-87826857a98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:17.947669 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5731946-367e-4b90-85c4-87826857a98c service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:17.957213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1433/2860] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:21.891983 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:21.962797 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6497-1d20-4793-bfac-ec3fbd99c8f9 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:21.969515 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:21.970223 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:21.970579 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:21.970857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] PATH_INFO: `/v3/users/83590e60af9d45f28280c5c7e55625d4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:21.972346 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83590e60af9d45f28280c5c7e55625d4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:21.974780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:21.980767 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=100 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:22.029423 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83590e60af9d45f28280c5c7e55625d4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.040889 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83590e60af9d45f28280c5c7e55625d4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.041536 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83590e60af9d45f28280c5c7e55625d4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.042113 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83590e60af9d45f28280c5c7e55625d4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.049318 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83590e60af9d45f28280c5c7e55625d4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.063877 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1428/2861] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:21 2022] DELETE /identity/v3/users/83590e60af9d45f28280c5c7e55625d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:22.068741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:22.069276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:22.069378 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:22.089897 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:22.091098 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:22.155756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1434/2862] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:22.165794 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:22.167462 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:22.227421 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea93a76-7f53-49ee-b252-a0f03ea403c6 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:22.232269 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:22.233043 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:22.233389 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:22.233739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:22.248591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:22.250660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:22.263916 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1429/2863] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:22.542024 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:22.543634 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:22.556194 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ae72c-1eda-41ce-8bed-5881e5fef805 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:22.563789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:22.563789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:22.563789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:22.563789 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] PATH_INFO: `/v3/projects/f7fd7e77286a4232a5843fa1b6ce1b76` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:22.564444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fd7e77286a4232a5843fa1b6ce1b76)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:22.566020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:22.626572 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fd7e77286a4232a5843fa1b6ce1b76', 'request_id': 'req-3451ada7-65cb-489f-b382-2e027cdf909d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.631947 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fd7e77286a4232a5843fa1b6ce1b76', 'request_id': 'req-3451ada7-65cb-489f-b382-2e027cdf909d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.640473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fd7e77286a4232a5843fa1b6ce1b76', 'request_id': 'req-3451ada7-65cb-489f-b382-2e027cdf909d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.652674 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] The token cache is being invalidate because project f7fd7e77286a4232a5843fa1b6ce1b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:22.652998 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.653641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.655142 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1435/2864] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:22 2022] DELETE /identity/v3/projects/f7fd7e77286a4232a5843fa1b6ce1b76 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:22.659433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:22.669047 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d9595-2bfe-4c7f-bd9a-1ddce454e322 service neutron] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:22.730013 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:22.730758 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:22.730935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:22.731204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] PATH_INFO: `/v3/users/974d5dbe8f3f40439091cfa1d2ea2070` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:22.732336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974d5dbe8f3f40439091cfa1d2ea2070)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:22.734415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:22.766089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:22.788112 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974d5dbe8f3f40439091cfa1d2ea2070'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.800599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974d5dbe8f3f40439091cfa1d2ea2070'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.801326 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974d5dbe8f3f40439091cfa1d2ea2070'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.801932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974d5dbe8f3f40439091cfa1d2ea2070'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.809225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974d5dbe8f3f40439091cfa1d2ea2070'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:22.824130 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1430/2865] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:22 2022] DELETE /identity/v3/users/974d5dbe8f3f40439091cfa1d2ea2070 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:23.115013 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:23.117470 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:23.143085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ada7-65cb-489f-b382-2e027cdf909d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:23.190368 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:23.208858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:23.209700 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:23.210119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:23.210531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] PATH_INFO: `/v3/projects/b200bb7b0d13484d84b691bd67ccb7b8` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:23.211956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b200bb7b0d13484d84b691bd67ccb7b8)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:23.213937 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:23.277678 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b200bb7b0d13484d84b691bd67ccb7b8', 'request_id': 'req-c66b952a-d3fc-46a3-a868-f48188a706d5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.280824 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b200bb7b0d13484d84b691bd67ccb7b8', 'request_id': 'req-c66b952a-d3fc-46a3-a868-f48188a706d5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.291693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b200bb7b0d13484d84b691bd67ccb7b8', 'request_id': 'req-c66b952a-d3fc-46a3-a868-f48188a706d5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.306115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] The token cache is being invalidate because project b200bb7b0d13484d84b691bd67ccb7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:23.306492 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.307226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.309038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1436/2866] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:23 2022] DELETE /identity/v3/projects/b200bb7b0d13484d84b691bd67ccb7b8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:23.313291 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:23.314947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:23.328337 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19dd0-3be2-4619-bcac-90e03fe48493 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:23.385392 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:23.386018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:23.386295 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:23.386566 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] PATH_INFO: `/v3/users/fdadabe3cc024d5da0cb142ca3c1efd4` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:23.387786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdadabe3cc024d5da0cb142ca3c1efd4)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:23.389743 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:23.437464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdadabe3cc024d5da0cb142ca3c1efd4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.449447 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdadabe3cc024d5da0cb142ca3c1efd4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.450053 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdadabe3cc024d5da0cb142ca3c1efd4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.450664 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdadabe3cc024d5da0cb142ca3c1efd4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.458406 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-9e943939-48d9-4066-9607-6f5dab26b4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdadabe3cc024d5da0cb142ca3c1efd4'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.473643 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1431/2867] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:23 2022] DELETE /identity/v3/users/fdadabe3cc024d5da0cb142ca3c1efd4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:23.752827 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:23.754445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:23.767535 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b952a-d3fc-46a3-a868-f48188a706d5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:23.826350 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:23.826986 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:23.827265 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:23.827531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] PATH_INFO: `/v3/projects/5ece98188ade4c31aec9dc4d5c6f2a2c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:23.828665 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ece98188ade4c31aec9dc4d5c6f2a2c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:23.830637 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:23.884119 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ece98188ade4c31aec9dc4d5c6f2a2c', 'request_id': 'req-b856863a-2fb2-467a-adf4-3092c12ef4b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.890438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ece98188ade4c31aec9dc4d5c6f2a2c', 'request_id': 'req-b856863a-2fb2-467a-adf4-3092c12ef4b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.900445 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ece98188ade4c31aec9dc4d5c6f2a2c', 'request_id': 'req-b856863a-2fb2-467a-adf4-3092c12ef4b6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.912132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] The token cache is being invalidate because project 5ece98188ade4c31aec9dc4d5c6f2a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:23.912416 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.913117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b856863a-2fb2-467a-adf4-3092c12ef4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:23.914641 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1437/2868] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:23 2022] DELETE /identity/v3/projects/5ece98188ade4c31aec9dc4d5c6f2a2c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:23.919669 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:23.919945 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:23.920209 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:23.940008 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:23.941214 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:23.960210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:24.005298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1432/2869] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:24.013038 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035573-b883-43b5-b154-81c61341690a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.013316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035573-b883-43b5-b154-81c61341690a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.013586 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035573-b883-43b5-b154-81c61341690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.022666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:24.034591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-74035573-b883-43b5-b154-81c61341690a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:24.036199 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74035573-b883-43b5-b154-81c61341690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:24.045146 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1438/2870] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:24.049736 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.060380 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8225d8-03b0-40c3-aeb9-bbe851c9fed1 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.066932 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.067632 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.067946 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.068239 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.068918 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81521) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:24.069310 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.071044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.087762 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1433/2871] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 04:17:24.091938 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035573-b883-43b5-b154-81c61341690a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.101739 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035573-b883-43b5-b154-81c61341690a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.107658 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.108695 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.109007 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.109357 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.109908 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.111793 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.143804 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1439/2872] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:24.148993 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.159529 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb8c9e-32db-4254-ad27-42d5656fb991 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.221089 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.221835 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.222255 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.222583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.223795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.226541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.255873 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1434/2873] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:24.260318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.270990 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eb61-3f75-405e-9c9a-2195f21742e8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.275992 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.276590 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.276903 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.277175 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.277820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.279409 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.289907 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1440/2874] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:24.294099 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.304853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f3ff9-f12e-4bfd-b34f-4db61d656c82 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.310765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68fba7-4a8d-4f9d-81ef-a1890b1b42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.311374 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68fba7-4a8d-4f9d-81ef-a1890b1b42ff admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.311651 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68fba7-4a8d-4f9d-81ef-a1890b1b42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.311925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68fba7-4a8d-4f9d-81ef-a1890b1b42ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.312578 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68fba7-4a8d-4f9d-81ef-a1890b1b42ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.314222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68fba7-4a8d-4f9d-81ef-a1890b1b42ff admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.325902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1435/2875] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:24.330271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.340498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf931b-9aee-4d5a-809c-be8285663d44 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.345673 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.346359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.346600 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.346872 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] PATH_INFO: `/v3/projects/175a0d0899864dc0b485f4e900039a25/users/3983a071c1c2449e8b3fbb09adae0b07/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.366231 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175a0d0899864dc0b485f4e900039a25, user_id=3983a071c1c2449e8b3fbb09adae0b07, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.369366 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.384036 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1441/2876] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:24 2022] PUT /identity/v3/projects/175a0d0899864dc0b485f4e900039a25/users/3983a071c1c2449e8b3fbb09adae0b07/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:24.395870 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.396191 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.396466 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.426162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] MFA Rules not processed for user `3983a071c1c2449e8b3fbb09adae0b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:24.427434 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:24.498860 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1436/2877] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:24.503621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.564970 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0cae-bd83-418c-967d-1009092b5056 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.569688 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.570294 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.570574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.570820 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.571473 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.573413 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.604191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1442/2878] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:24.608379 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.619933 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcee126-fac0-458e-bf48-2dd1c943dba8 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.637177 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:24.678415 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.679028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.679302 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.679568 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.680225 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.682222 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.704408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1437/2879] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:24.709386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.720405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948603a9-8e4a-4509-91d4-33aead81e86a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.725559 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.726181 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.726458 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.726727 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.727406 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.729136 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.740277 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1443/2880] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:24.745408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.761319 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6276-dd77-45d2-ae5c-2a75c7f384c4 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.768552 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed73a5-81a4-4f73-8024-9259d261ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.769185 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed73a5-81a4-4f73-8024-9259d261ff83 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.769460 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed73a5-81a4-4f73-8024-9259d261ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.769724 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed73a5-81a4-4f73-8024-9259d261ff83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.770366 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed73a5-81a4-4f73-8024-9259d261ff83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.771999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed73a5-81a4-4f73-8024-9259d261ff83 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.782320 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1438/2881] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:24.786709 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:24.797221 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2775aef-f955-4c04-96c4-6a71d954433d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:24.802476 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:24.803240 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.803538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.803791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] PATH_INFO: `/v3/projects/b27668bb76354abe8bb7b8acff56643d/users/e5ed6b22395e4a28aac036dde9356524/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.820448 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27668bb76354abe8bb7b8acff56643d, user_id=e5ed6b22395e4a28aac036dde9356524, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:24.823048 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:24.838920 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1444/2882] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:24 2022] PUT /identity/v3/projects/b27668bb76354abe8bb7b8acff56643d/users/e5ed6b22395e4a28aac036dde9356524/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:24.849717 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:24.849997 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:24.850264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:24.880408 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] MFA Rules not processed for user `e5ed6b22395e4a28aac036dde9356524`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:24.881704 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:24.957730 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1439/2883] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:24.964483 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.024189 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:25.043841 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a15f-be5f-4281-8f1f-8de05dfb3b6c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.051834 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.052748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.053160 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.053510 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.054425 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.057430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.091333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1445/2884] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:24 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:25.096092 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.109849 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7ca6-1754-41c8-8f1f-9111876cc1ef None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.173330 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.173947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.174221 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.174508 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.175545 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.177152 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.203487 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1440/2885] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:25 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:25.205041 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.216564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48908da-e6db-41b3-9f84-897ec56533d8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.222304 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.223176 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.223468 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.223811 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.224493 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.226683 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.239712 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1446/2886] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:25.244535 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.255979 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f09d3-ca81-4797-8579-f1cd189ccada admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.260622 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.261306 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.261580 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.261850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] PATH_INFO: `/v3/projects/fc5a08a565204f668c0eb562d44fd1e3/users/45f131eb281444d0bb253a3bad2fe1ec/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.276574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5a08a565204f668c0eb562d44fd1e3, user_id=45f131eb281444d0bb253a3bad2fe1ec, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.279247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.281451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:25.294316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1441/2887] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:25 2022] PUT /identity/v3/projects/fc5a08a565204f668c0eb562d44fd1e3/users/45f131eb281444d0bb253a3bad2fe1ec/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:25.298869 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.309900 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67414a-c53d-493b-a692-f460ca11667e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.374008 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed27eb-bdf9-4d7d-93f5-7a48b98a1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.374682 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed27eb-bdf9-4d7d-93f5-7a48b98a1044 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.374942 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed27eb-bdf9-4d7d-93f5-7a48b98a1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.375213 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed27eb-bdf9-4d7d-93f5-7a48b98a1044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.375874 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed27eb-bdf9-4d7d-93f5-7a48b98a1044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.377490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed27eb-bdf9-4d7d-93f5-7a48b98a1044 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.387285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1447/2888] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:25.391898 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.403126 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466cd71-466a-419d-8224-2848d78b2934 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.409260 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.410151 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.410473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.410802 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] PATH_INFO: `/v3/projects/fc5a08a565204f668c0eb562d44fd1e3/users/45f131eb281444d0bb253a3bad2fe1ec/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.412774 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5a08a565204f668c0eb562d44fd1e3, user_id=45f131eb281444d0bb253a3bad2fe1ec, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.415458 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.427316 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1442/2889] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:25 2022] PUT /identity/v3/projects/fc5a08a565204f668c0eb562d44fd1e3/users/45f131eb281444d0bb253a3bad2fe1ec/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:25.438112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.438395 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.438667 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.467222 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] MFA Rules not processed for user `45f131eb281444d0bb253a3bad2fe1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:25.468542 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:25.554212 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1448/2890] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:25.562750 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.565252 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:25.632583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f6237-2720-4bd5-ae93-2650d1aaf9bc admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.637340 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.637960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.638237 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.638507 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.724710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.726553 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.732293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:25.733843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:25.739726 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1443/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:25.806273 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:25.829152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a6a18-6d22-4c9e-bcb1-093f03ef8913 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:25.833849 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:25.834499 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:25.834826 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:25.835254 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] PATH_INFO: `/v3/users/00133c444368459eba906d2349488922` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:25.836422 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00133c444368459eba906d2349488922)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:25.838580 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:25.889042 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00133c444368459eba906d2349488922'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:25.896967 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00133c444368459eba906d2349488922'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:25.906705 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00133c444368459eba906d2349488922'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:25.907489 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00133c444368459eba906d2349488922'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:25.920791 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00133c444368459eba906d2349488922'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:25.927369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1449/2892] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:25 2022] DELETE /identity/v3/users/00133c444368459eba906d2349488922 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:26.111988 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:26.123908 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0156bd-9014-4ab8-8c9a-e994f1058066 service cinder] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:26.187618 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:26.188264 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:26.188541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:26.188820 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] PATH_INFO: `/v3/projects/beb6be3e82044689a166299cd30c5fa5` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:26.190077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb6be3e82044689a166299cd30c5fa5)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:26.192003 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:26.232934 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:26.243498 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb6be3e82044689a166299cd30c5fa5', 'request_id': 'req-eefb6719-acd6-439a-bee3-499ceab8049a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:26.250031 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb6be3e82044689a166299cd30c5fa5', 'request_id': 'req-eefb6719-acd6-439a-bee3-499ceab8049a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:26.256119 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb6be3e82044689a166299cd30c5fa5', 'request_id': 'req-eefb6719-acd6-439a-bee3-499ceab8049a'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:26.271473 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] The token cache is being invalidate because project beb6be3e82044689a166299cd30c5fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:26.271763 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:26.272433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:26.273956 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1444/2893] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:26 2022] DELETE /identity/v3/projects/beb6be3e82044689a166299cd30c5fa5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:27.300343 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:27.302112 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:27.361876 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfd6c5-c42b-4eec-8437-b6b66f3a7de7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:27.413385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:27.414020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:27.414300 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:27.414573 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:27.416404 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:27.453363 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:27.485813 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:27.487288 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:27.497283 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1450/2894] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:28.058999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:28.060999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:28.073973 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6719-acd6-439a-bee3-499ceab8049a admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:28.078157 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:28.078765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:28.079042 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:28.079312 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:28.081453 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:28.154363 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:28.155806 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc13e2f-27f5-4a54-9797-d3ec1395f455 service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:28.166147 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1445/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:30.688670 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:30.693956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:30.762878 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a13dbf-0429-4b5d-9e2d-c457655bc5ee service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:30.767444 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:30.768047 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:30.768324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:30.768596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] PATH_INFO: `/v3/users/c2d9009a29404478a76d17636a2a9516` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:30.769746 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d9009a29404478a76d17636a2a9516)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:30.771661 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:30.821799 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d9009a29404478a76d17636a2a9516'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:30.829868 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d9009a29404478a76d17636a2a9516'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:30.843430 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d9009a29404478a76d17636a2a9516'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:30.844079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d9009a29404478a76d17636a2a9516'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:30.856475 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d9009a29404478a76d17636a2a9516'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:30.862576 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1451/2896] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:30 2022] DELETE /identity/v3/users/c2d9009a29404478a76d17636a2a9516 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:30.867424 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:30.867906 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:30.868002 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:30.889075 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:30.890615 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:30.953963 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1446/2897] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:30.964529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:30.966082 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:31.027932 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363e01-e38c-4735-ae8a-cca617e6758f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:31.031582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:31.032219 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:31.032496 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:31.032782 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:31.041574 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:31.043101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:31.046912 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:31.053482 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1452/2898] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:31.336519 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:31.338104 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:31.351484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf445653-c8d9-4cc0-a6f7-048ef80eccdc None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:31.357107 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:31.357761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:31.358039 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:31.358410 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] PATH_INFO: `/v3/projects/6b2140a8b1fe4c429b1f0bcc41044eb8` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:31.359523 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2140a8b1fe4c429b1f0bcc41044eb8)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:31.361770 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:31.411301 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2140a8b1fe4c429b1f0bcc41044eb8', 'request_id': 'req-66583415-98fe-4532-9f2d-35e70e51ae56'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.417826 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2140a8b1fe4c429b1f0bcc41044eb8', 'request_id': 'req-66583415-98fe-4532-9f2d-35e70e51ae56'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.419054 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:31.424923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2140a8b1fe4c429b1f0bcc41044eb8', 'request_id': 'req-66583415-98fe-4532-9f2d-35e70e51ae56'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.438576 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] The token cache is being invalidate because project 6b2140a8b1fe4c429b1f0bcc41044eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:31.438859 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.439484 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.440992 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1447/2899] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:31 2022] DELETE /identity/v3/projects/6b2140a8b1fe4c429b1f0bcc41044eb8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:31.445204 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:31.454975 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07212a-cd7a-46d4-bac3-7530ef764364 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:31.515983 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:31.516643 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:31.516950 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:31.517220 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] PATH_INFO: `/v3/users/bd40d118659444a6bfec05e9d7c6754c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:31.518367 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd40d118659444a6bfec05e9d7c6754c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:31.520369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:31.567582 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd40d118659444a6bfec05e9d7c6754c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.574538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd40d118659444a6bfec05e9d7c6754c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.584276 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd40d118659444a6bfec05e9d7c6754c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.585051 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd40d118659444a6bfec05e9d7c6754c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.598111 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-db899f03-64fb-41bd-96c7-d499c0eb1086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd40d118659444a6bfec05e9d7c6754c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:31.604020 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1453/2900] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:31 2022] DELETE /identity/v3/users/bd40d118659444a6bfec05e9d7c6754c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:31.881275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:31.882711 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:31.903362 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66583415-98fe-4532-9f2d-35e70e51ae56 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:31.964660 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:31.965249 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:31.965521 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:31.965786 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] PATH_INFO: `/v3/projects/81481f2e7a004e63b20ee1979ef560cb` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:31.967016 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81481f2e7a004e63b20ee1979ef560cb)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:31.968974 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.023795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81481f2e7a004e63b20ee1979ef560cb', 'request_id': 'req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.030336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81481f2e7a004e63b20ee1979ef560cb', 'request_id': 'req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.036537 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81481f2e7a004e63b20ee1979ef560cb', 'request_id': 'req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.051910 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] The token cache is being invalidate because project 81481f2e7a004e63b20ee1979ef560cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:32.052203 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.052848 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.054432 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1448/2901] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:31 2022] DELETE /identity/v3/projects/81481f2e7a004e63b20ee1979ef560cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:32.059625 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1acdcd-7928-4726-b4db-005b2f69b4e1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.060106 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1acdcd-7928-4726-b4db-005b2f69b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.060259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1acdcd-7928-4726-b4db-005b2f69b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.080465 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cc1acdcd-7928-4726-b4db-005b2f69b4e1 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:32.081703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cc1acdcd-7928-4726-b4db-005b2f69b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.088365 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.089953 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.144437 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1454/2902] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:32.152405 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.152714 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.153016 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.155977 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ac55-644d-4fbc-8b7f-fd994f9aa7d1 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.160928 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.161574 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.161850 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.162116 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] PATH_INFO: `/v3/users/3983a071c1c2449e8b3fbb09adae0b07` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.163324 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3983a071c1c2449e8b3fbb09adae0b07)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.165271 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.172620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:32.173858 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.179705 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:32.182159 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1455/2903] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:32.186601 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.197117 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d3372-10e5-4075-a314-257e0d44f699 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.202619 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.203438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.203805 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.204161 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.204924 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:32.205312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.207025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.214191 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:32.216490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3983a071c1c2449e8b3fbb09adae0b07'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.223408 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1456/2904] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:17:32.224520 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.234056 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3983a071c1c2449e8b3fbb09adae0b07'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.234761 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3983a071c1c2449e8b3fbb09adae0b07'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.235376 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3983a071c1c2449e8b3fbb09adae0b07'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.235964 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311d476-7aea-45ff-9314-e660c399a8bb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.241268 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.241862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.242139 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.242411 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.242541 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-40433815-12b7-43af-b5fe-4b40e33c2c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3983a071c1c2449e8b3fbb09adae0b07'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:32.243028 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.247457 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.258857 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1449/2905] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:32 2022] DELETE /identity/v3/users/3983a071c1c2449e8b3fbb09adae0b07 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:32.263888 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.264189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.264489 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.278316 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1457/2906] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/projects => generated 407 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:32.279571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.281324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.284087 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:32.285290 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.343451 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1450/2907] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:32.343890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060d3ba-4e68-4367-824a-320aa010baed admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.348452 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.349086 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.349385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.349629 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.350253 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.352498 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.353411 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.354824 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.375079 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1458/2908] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:32.379103 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.389301 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ea9a7-4791-496c-a539-be2199b55de4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.394101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.394687 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.394959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.395226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.395866 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.397487 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.407362 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1459/2909] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:32.411707 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.414160 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b042-d735-4b8f-a6ba-3b62c742ce6b None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.418843 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e5071-8fac-43c2-b5c2-79f2dcda7c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.419461 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e5071-8fac-43c2-b5c2-79f2dcda7c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.419735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e5071-8fac-43c2-b5c2-79f2dcda7c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.419999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e5071-8fac-43c2-b5c2-79f2dcda7c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.421741 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c1a4-58e9-4790-aded-5bd689932c8a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.426290 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.426875 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.427152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.427439 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.428064 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.429691 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.431183 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e5071-8fac-43c2-b5c2-79f2dcda7c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.432610 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e5071-8fac-43c2-b5c2-79f2dcda7c5e service neutron] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.440843 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1460/2910] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 04:17:32.445271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.446490 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1451/2911] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:17:32.455252 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76202d-fb47-4f4a-90a9-04430ba8ea76 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.459708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.460346 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.460621 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.460939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] PATH_INFO: `/v3/projects/4ac1473c466b45b7bf84fe014979c150/users/590a37fb51ae4f6ba9225022d2446640/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.476702 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac1473c466b45b7bf84fe014979c150, user_id=590a37fb51ae4f6ba9225022d2446640, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.479384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.492587 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1461/2912] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:32 2022] PUT /identity/v3/projects/4ac1473c466b45b7bf84fe014979c150/users/590a37fb51ae4f6ba9225022d2446640/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:32.504978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.505539 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.505697 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.534620 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] MFA Rules not processed for user `590a37fb51ae4f6ba9225022d2446640`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:32.535923 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:32.560349 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:32.604911 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1452/2913] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:32.609518 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.673297 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0137-f227-4e36-b8a6-920b5935e189 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.678353 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.678965 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.679239 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.679505 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.680135 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.682058 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.716359 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1462/2914] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:32.720449 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.731765 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3709338-eba9-4861-84a9-c4cc37f5da0d None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.794265 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.794897 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.795178 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.795445 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] PATH_INFO: `/v3/users` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.796106 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.798179 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.821100 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1453/2915] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:32 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:32.825147 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.831909 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:32.836293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2fc2-7a03-4c11-98e4-e4080efc5852 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.842765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.843417 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.843693 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.843959 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.844607 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.846313 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.858154 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1463/2916] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:32.862452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.873559 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22fce-acb6-48f5-857b-b27edaab6718 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.878355 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.879032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.879304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.879573 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] PATH_INFO: `/v3/projects/dd8f64865d454e50a8553c24fa4a62ba/users/a371222a6e954c27bef6049962dbf730/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.896044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8f64865d454e50a8553c24fa4a62ba, user_id=a371222a6e954c27bef6049962dbf730, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.898734 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:32.913352 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1454/2917] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:32 2022] PUT /identity/v3/projects/dd8f64865d454e50a8553c24fa4a62ba/users/a371222a6e954c27bef6049962dbf730/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:32.918063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:32.928756 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fff30-714f-420b-a52f-5f47810a21e4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:32.990564 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:32.991260 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:32.991536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:32.991838 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:32.992630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:32.994571 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.003327 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.005162 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:33.005698 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1464/2918] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:33.009432 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.022318 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2af202-5694-4073-a298-789b39f08a79 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.023795 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f253f65-5e2e-482b-9d8a-538a9712883b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.027657 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222e99-4bb1-44b3-9d13-cade2caceffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.028529 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222e99-4bb1-44b3-9d13-cade2caceffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.028864 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222e99-4bb1-44b3-9d13-cade2caceffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.029097 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222e99-4bb1-44b3-9d13-cade2caceffc admin admin] PATH_INFO: `/v3/projects/dd8f64865d454e50a8553c24fa4a62ba/users/a371222a6e954c27bef6049962dbf730/roles/faea311d34554d2b9ce4434210a27c8f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.031179 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222e99-4bb1-44b3-9d13-cade2caceffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8f64865d454e50a8553c24fa4a62ba, user_id=a371222a6e954c27bef6049962dbf730, role_id=faea311d34554d2b9ce4434210a27c8f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.033854 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222e99-4bb1-44b3-9d13-cade2caceffc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.036450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.037495 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.037775 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.038051 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] PATH_INFO: `/v3/projects/175a0d0899864dc0b485f4e900039a25` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.039187 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=175a0d0899864dc0b485f4e900039a25)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.041123 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.044389 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1465/2919] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:33 2022] PUT /identity/v3/projects/dd8f64865d454e50a8553c24fa4a62ba/users/a371222a6e954c27bef6049962dbf730/roles/faea311d34554d2b9ce4434210a27c8f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:33.054850 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.055129 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.055394 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.082508 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] MFA Rules not processed for user `a371222a6e954c27bef6049962dbf730`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:33.083703 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:33.090562 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175a0d0899864dc0b485f4e900039a25', 'request_id': 'req-c2fbdd50-6ee8-44ea-80ec-003292423df2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.097045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175a0d0899864dc0b485f4e900039a25', 'request_id': 'req-c2fbdd50-6ee8-44ea-80ec-003292423df2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.102694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175a0d0899864dc0b485f4e900039a25', 'request_id': 'req-c2fbdd50-6ee8-44ea-80ec-003292423df2'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.116635 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] The token cache is being invalidate because project 175a0d0899864dc0b485f4e900039a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:33.117149 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.117985 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.119659 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1455/2920] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:33 2022] DELETE /identity/v3/projects/175a0d0899864dc0b485f4e900039a25 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:33.124210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.126044 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:33.146723 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:33.158630 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1466/2921] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 04:17:33.170519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.171962 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:33.207996 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbdd50-6ee8-44ea-80ec-003292423df2 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.213463 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.214154 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.214587 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.214865 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] PATH_INFO: `/v3/users/e5ed6b22395e4a28aac036dde9356524` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.216161 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ed6b22395e4a28aac036dde9356524)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.218393 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.238716 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979bc9-7f64-40dd-b346-0fb92b8c614c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.243840 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.244384 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.244660 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.245324 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.258369 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.260030 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.271078 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1467/2922] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:33 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 04:17:33.279080 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ed6b22395e4a28aac036dde9356524'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.295948 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ed6b22395e4a28aac036dde9356524'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.296720 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ed6b22395e4a28aac036dde9356524'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.297395 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ed6b22395e4a28aac036dde9356524'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.307902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ed6b22395e4a28aac036dde9356524'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.323866 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1456/2923] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:33 2022] DELETE /identity/v3/users/e5ed6b22395e4a28aac036dde9356524 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:33.436679 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.442455 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:33.445728 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7b8de-10b8-410b-a463-7dc836a6313f service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.498201 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.498752 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.499025 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.499291 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.501092 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:33.566939 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.568398 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.577541 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1468/2924] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:33 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:33.613086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.614676 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:33.686304 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5a73-ecc6-4c81-84cc-3ad2e3ec31c5 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.692049 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.692930 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.693210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.693479 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] PATH_INFO: `/v3/projects/b27668bb76354abe8bb7b8acff56643d` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.694602 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27668bb76354abe8bb7b8acff56643d)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.696499 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.737292 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:33.749036 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27668bb76354abe8bb7b8acff56643d', 'request_id': 'req-af56d6c4-91ad-478d-9dcb-d8d300048507'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.758140 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27668bb76354abe8bb7b8acff56643d', 'request_id': 'req-af56d6c4-91ad-478d-9dcb-d8d300048507'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.763853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27668bb76354abe8bb7b8acff56643d', 'request_id': 'req-af56d6c4-91ad-478d-9dcb-d8d300048507'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.777570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] The token cache is being invalidate because project b27668bb76354abe8bb7b8acff56643d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:33.777853 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.778464 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.779947 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1457/2925] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:33 2022] DELETE /identity/v3/projects/b27668bb76354abe8bb7b8acff56643d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:33.784132 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:33.795197 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87428f6-d8da-4e1c-89f9-6b57915e45a4 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:33.853522 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:33.854312 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:33.854591 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:33.854862 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] PATH_INFO: `/v3/users/45f131eb281444d0bb253a3bad2fe1ec` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:33.856026 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f131eb281444d0bb253a3bad2fe1ec)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:33.858054 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:33.912941 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f131eb281444d0bb253a3bad2fe1ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.920101 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f131eb281444d0bb253a3bad2fe1ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.924128 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:33.928060 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f131eb281444d0bb253a3bad2fe1ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.929152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f131eb281444d0bb253a3bad2fe1ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.943382 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f131eb281444d0bb253a3bad2fe1ec'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:33.949451 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1469/2926] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:33 2022] DELETE /identity/v3/users/45f131eb281444d0bb253a3bad2fe1ec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:34.220815 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:34.222325 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:34.240343 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56d6c4-91ad-478d-9dcb-d8d300048507 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:34.308970 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:34.309641 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:34.309925 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:34.310190 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] PATH_INFO: `/v3/projects/fc5a08a565204f668c0eb562d44fd1e3` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:34.311446 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5a08a565204f668c0eb562d44fd1e3)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:34.313438 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:34.373780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5a08a565204f668c0eb562d44fd1e3', 'request_id': 'req-7db570ba-af14-47be-a667-f0c8f593b8c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:34.380045 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5a08a565204f668c0eb562d44fd1e3', 'request_id': 'req-7db570ba-af14-47be-a667-f0c8f593b8c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:34.388164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5a08a565204f668c0eb562d44fd1e3', 'request_id': 'req-7db570ba-af14-47be-a667-f0c8f593b8c7'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:34.406215 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] The token cache is being invalidate because project fc5a08a565204f668c0eb562d44fd1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:34.406522 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:34.407202 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-7db570ba-af14-47be-a667-f0c8f593b8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:34.408780 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1458/2927] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:34 2022] DELETE /identity/v3/projects/fc5a08a565204f668c0eb562d44fd1e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:38.946594 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:38.948122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:38.961308 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b902b72-d9f4-4330-ae9d-378676c0ad30 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:39.019438 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:39.020085 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:39.020361 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:39.020671 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] PATH_INFO: `/v3/users/590a37fb51ae4f6ba9225022d2446640` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:39.022011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590a37fb51ae4f6ba9225022d2446640)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:39.023996 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:39.073284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590a37fb51ae4f6ba9225022d2446640'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.080490 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590a37fb51ae4f6ba9225022d2446640'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.088748 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590a37fb51ae4f6ba9225022d2446640'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.089859 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590a37fb51ae4f6ba9225022d2446640'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.108271 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590a37fb51ae4f6ba9225022d2446640'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.114418 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1470/2928] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:38 2022] DELETE /identity/v3/users/590a37fb51ae4f6ba9225022d2446640 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:39.119778 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:39.120637 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:39.120739 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:39.145646 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:39.146875 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:39.194927 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:39.210014 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1459/2929] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:39.221464 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:39.222976 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:39.283281 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0eda3-4ad9-4beb-bd96-687a140cb252 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:39.290434 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:39.291293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:39.291639 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:39.291987 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:39.306618 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:39.308737 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:39.314697 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:39.319853 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1471/2930] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:39.601485 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:39.603077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:39.616766 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ef8a-79b3-4766-b737-08ac107e4a9a None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:39.622007 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:39.622648 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:39.622926 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:39.623196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] PATH_INFO: `/v3/projects/4ac1473c466b45b7bf84fe014979c150` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:39.624357 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac1473c466b45b7bf84fe014979c150)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:39.626437 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:39.672827 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac1473c466b45b7bf84fe014979c150', 'request_id': 'req-35e0f913-7bd3-423a-b802-97e5e0384ffd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.679321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac1473c466b45b7bf84fe014979c150', 'request_id': 'req-35e0f913-7bd3-423a-b802-97e5e0384ffd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.685450 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac1473c466b45b7bf84fe014979c150', 'request_id': 'req-35e0f913-7bd3-423a-b802-97e5e0384ffd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.698609 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] The token cache is being invalidate because project 4ac1473c466b45b7bf84fe014979c150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:39.698899 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.699525 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.701040 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1460/2931] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:39 2022] DELETE /identity/v3/projects/4ac1473c466b45b7bf84fe014979c150 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:39.705326 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:39.715000 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd50a1-32a4-41bc-a0d3-481c61cdbfa3 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:39.774538 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:39.775169 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:39.775441 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:39.775708 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] PATH_INFO: `/v3/users/a371222a6e954c27bef6049962dbf730` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:39.776911 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a371222a6e954c27bef6049962dbf730)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:39.778821 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:39.827848 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a371222a6e954c27bef6049962dbf730'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.835063 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a371222a6e954c27bef6049962dbf730'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.843531 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a371222a6e954c27bef6049962dbf730'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.844122 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a371222a6e954c27bef6049962dbf730'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.855961 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a302a672-c456-4fbd-ba05-47124d8dafd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a371222a6e954c27bef6049962dbf730'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:39.861865 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1472/2932] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:39 2022] DELETE /identity/v3/users/a371222a6e954c27bef6049962dbf730 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:40.155189 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.156854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:40.170652 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0f913-7bd3-423a-b802-97e5e0384ffd admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.237028 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.237593 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.237894 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.238164 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] PATH_INFO: `/v3/projects/dd8f64865d454e50a8553c24fa4a62ba` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.239452 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8f64865d454e50a8553c24fa4a62ba)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.241520 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.288086 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8f64865d454e50a8553c24fa4a62ba', 'request_id': 'req-069e8d29-4ada-4f4a-911d-58b617b6dac3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:40.294375 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8f64865d454e50a8553c24fa4a62ba', 'request_id': 'req-069e8d29-4ada-4f4a-911d-58b617b6dac3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:40.300371 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8f64865d454e50a8553c24fa4a62ba', 'request_id': 'req-069e8d29-4ada-4f4a-911d-58b617b6dac3'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:40.318248 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] The token cache is being invalidate because project dd8f64865d454e50a8553c24fa4a62ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:40.318619 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:40.319662 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-069e8d29-4ada-4f4a-911d-58b617b6dac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:40.322102 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1461/2933] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:40 2022] DELETE /identity/v3/projects/dd8f64865d454e50a8553c24fa4a62ba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 04:17:40.328314 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.328886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.328886 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.349196 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:40.350387 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:40.415385 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1473/2934] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:40.423570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.423854 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.424122 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.439960 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:40.445905 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:40.448072 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:40.456735 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1462/2935] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:40.461035 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.470796 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086255b-4727-44aa-b53e-84faa4847e92 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.475519 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.476115 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.476386 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.476654 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.477327 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 04:17:40.477627 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.479223 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.491972 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1474/2936] 10.222.0.25 () {58 vars in 1153 bytes} [Wed Aug 31 04:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 04:17:40.496631 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.506077 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba03dd5-441a-4fe7-adef-78fb4f0ead74 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.511115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.511710 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.511982 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.512247 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.512935 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.514965 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.543784 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1463/2937] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Aug 31 04:17:40 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 04:17:40.548073 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.558477 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d9fe2-b82b-4a47-ad0e-c01c0eca54e2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.562120 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:40.621145 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.621747 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.622018 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.622284 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.622901 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.624825 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.645259 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1475/2938] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Aug 31 04:17:40 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 04:17:40.650534 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.661783 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc603d-4c0a-48ff-8c97-6c7da5f8db3b admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.667210 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.667842 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.668115 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.668384 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.669081 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.670694 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.681208 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1464/2939] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:40.685303 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.695999 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4f934-94e7-4175-acbc-e3ed31a75987 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.701333 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a52a-7cdf-4a66-afa8-fa164d50b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.701956 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a52a-7cdf-4a66-afa8-fa164d50b70d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.702266 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a52a-7cdf-4a66-afa8-fa164d50b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.702533 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a52a-7cdf-4a66-afa8-fa164d50b70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.703174 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a52a-7cdf-4a66-afa8-fa164d50b70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.704781 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a52a-7cdf-4a66-afa8-fa164d50b70d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.715706 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1476/2940] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Aug 31 04:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 04:17:40.720204 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.730583 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca73c0-7737-4a03-b63d-fcaddb5bef04 admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:40.736336 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:40.737032 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.737300 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.737564 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] PATH_INFO: `/v3/projects/5e6973b996794f1e840bcae1b2ffcd26/users/6eac4dcc7b874924b4084158ca73415f/roles/0450bb9e1ea24945a740dbef97a2c837` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.753356 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6973b996794f1e840bcae1b2ffcd26, user_id=6eac4dcc7b874924b4084158ca73415f, role_id=0450bb9e1ea24945a740dbef97a2c837)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:40.755939 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:40.769745 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1465/2941] 10.222.0.25 () {60 vars in 1483 bytes} [Wed Aug 31 04:17:40 2022] PUT /identity/v3/projects/5e6973b996794f1e840bcae1b2ffcd26/users/6eac4dcc7b874924b4084158ca73415f/roles/0450bb9e1ea24945a740dbef97a2c837 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:40.837765 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:40.838037 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:40.838338 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:40.868341 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] MFA Rules not processed for user `6eac4dcc7b874924b4084158ca73415f`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:40.869562 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:40.942536 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1477/2942] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:40.977917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:40.979978 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:41.040714 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d1506-bf6b-4196-a492-0163e71ee7fb admin admin] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:41.044917 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f4448-c2fe-4155-8a97-6ae5910000ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5557665d603448c3bdeed0b5701e8ce2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:41.045530 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f4448-c2fe-4155-8a97-6ae5910000ba service cinder] REQUEST_METHOD: `GET` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:41.045841 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f4448-c2fe-4155-8a97-6ae5910000ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:41.046108 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f4448-c2fe-4155-8a97-6ae5910000ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:41.054665 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f4448-c2fe-4155-8a97-6ae5910000ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:41.056088 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f4448-c2fe-4155-8a97-6ae5910000ba service cinder] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:41.065196 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1466/2943] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:41.081620 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:41.154640 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea3e6-69a9-4f3c-8a1c-b6e03dd32cf1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:41.159994 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:41.160650 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:41.160955 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:41.161226 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] PATH_INFO: `/v3/users/6eac4dcc7b874924b4084158ca73415f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:41.162460 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eac4dcc7b874924b4084158ca73415f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:41.164442 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:41.181337 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:41.214676 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eac4dcc7b874924b4084158ca73415f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.221735 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eac4dcc7b874924b4084158ca73415f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.231890 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eac4dcc7b874924b4084158ca73415f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.232560 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eac4dcc7b874924b4084158ca73415f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.244787 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eac4dcc7b874924b4084158ca73415f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.251011 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1478/2944] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Aug 31 04:17:41 2022] DELETE /identity/v3/users/6eac4dcc7b874924b4084158ca73415f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:41.255591 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] REQUEST_METHOD: `POST` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:41.256066 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:41.256167 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:41.276061 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.auth.core [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] MFA Rules not processed for user `04aa24ab71874e53bb3391c530b11528`. Rule list: `[]` (Enabled: `True`). {{(pid=81521) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 04:17:41.277344 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:41.339599 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1467/2945] 10.222.0.25 () {58 vars in 958 bytes} [Wed Aug 31 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 04:17:41.349764 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:41.351293 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:41.419134 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627eb08-40b9-43c6-b980-3f64958db0ad admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:41.424512 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36e52c9271db4196a138de433b75b422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:41.425152 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:41.425424 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:41.425689 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:41.435595 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:41.437141 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:41.446771 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1479/2946] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:17:41.743275 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] Authenticating user token {{(pid=81521) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:17:41.744808 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.fernet_utils [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81521) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:17:41.761799 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c7b1-2a79-413d-9a8f-99f739a97791 None None] Validating token access rules against request {{(pid=81521) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:17:41.767902 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04aa24ab71874e53bb3391c530b11528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f412dcfcdac460e92b9728f91705fbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81521) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:17:41.768661 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:17:41.769018 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:17:41.769298 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] PATH_INFO: `/v3/projects/5e6973b996794f1e840bcae1b2ffcd26` {{(pid=81521) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:17:41.770433 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6973b996794f1e840bcae1b2ffcd26)` {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:17:41.772321 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] RBAC: Authorization granted {{(pid=81521) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:17:41.819777 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:41.828180 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6973b996794f1e840bcae1b2ffcd26', 'request_id': 'req-737862d4-b25e-4340-98ca-1f701ec7f6dd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.834999 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6973b996794f1e840bcae1b2ffcd26', 'request_id': 'req-737862d4-b25e-4340-98ca-1f701ec7f6dd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.840890 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6973b996794f1e840bcae1b2ffcd26', 'request_id': 'req-737862d4-b25e-4340-98ca-1f701ec7f6dd'} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.854492 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] The token cache is being invalidate because project 5e6973b996794f1e840bcae1b2ffcd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81521) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 04:17:41.854699 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.855313 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG keystone.notifications [None req-737862d4-b25e-4340-98ca-1f701ec7f6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81521) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 04:17:41.856876 dv-cinder-853910-5-smb devstack@keystone.service[81521]: [pid: 81521|app: 0|req: 1468/2947] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Aug 31 04:17:41 2022] DELETE /identity/v3/projects/5e6973b996794f1e840bcae1b2ffcd26 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 04:17:51.442801 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:17:51.851570 dv-cinder-853910-5-smb devstack@keystone.service[81521]: DEBUG dbcounter [-] [81521] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81521) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 04:20:47.093666 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 04:20:47.095285 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:20:47.170951 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786496c6-10fb-41b4-ab42-de99b94253fe service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 04:20:47.235370 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa033d69cc014795896c16c63414f4a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7514901da21f40398a0143744fd11757', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 04:20:47.235993 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 04:20:47.236331 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 04:20:47.236596 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 04:20:47.238610 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 04:20:47.250537 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 04:20:47.252149 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58ee80-455e-45f0-a0fd-56882d6d5edf service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 04:20:47.262105 dv-cinder-853910-5-smb devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1480/2948] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Aug 31 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 04:20:57.258087 dv-cinder-853910-5-smb devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=58 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}